2023-07-12 10:53:22,590 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-12 10:53:22,841 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7 2023-07-12 10:53:22,842 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-12 10:53:22,842 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-12 10:53:22,879 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 10:53:23,145 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 10:53:23,146 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19, deleteOnExit=true 2023-07-12 10:53:23,146 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 10:53:23,147 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/test.cache.data in system properties and HBase conf 2023-07-12 10:53:23,147 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 10:53:23,148 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/hadoop.log.dir in system properties and HBase conf 2023-07-12 10:53:23,148 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 10:53:23,149 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 10:53:23,149 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 10:53:23,516 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 10:53:23,523 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 10:53:23,524 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 10:53:23,524 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 10:53:23,525 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 10:53:23,525 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 10:53:23,526 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 10:53:23,526 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 10:53:23,526 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 10:53:23,527 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 10:53:23,527 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/nfs.dump.dir in system properties and HBase conf 2023-07-12 10:53:23,528 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/java.io.tmpdir in system properties and HBase conf 2023-07-12 10:53:23,528 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 10:53:23,529 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 10:53:23,529 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 10:53:24,101 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 10:53:24,105 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 10:53:24,378 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 10:53:24,570 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 10:53:24,587 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:24,621 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:24,652 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/java.io.tmpdir/Jetty_localhost_45675_hdfs____.b616n7/webapp 2023-07-12 10:53:24,823 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45675 2023-07-12 10:53:24,851 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 10:53:24,851 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 10:53:25,444 WARN [Listener at localhost/44111] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 10:53:25,532 WARN [Listener at localhost/44111] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 10:53:25,555 WARN [Listener at localhost/44111] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:25,563 INFO [Listener at localhost/44111] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:25,570 INFO [Listener at localhost/44111] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/java.io.tmpdir/Jetty_localhost_41077_datanode____.grl5ie/webapp 2023-07-12 10:53:25,680 INFO [Listener at localhost/44111] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41077 2023-07-12 10:53:26,263 WARN [Listener at localhost/36935] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 10:53:26,321 WARN [Listener at localhost/36935] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 10:53:26,330 WARN [Listener at localhost/36935] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:26,332 INFO [Listener at localhost/36935] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:26,351 INFO [Listener at localhost/36935] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/java.io.tmpdir/Jetty_localhost_46453_datanode____5ugsmv/webapp 2023-07-12 10:53:26,512 INFO [Listener at localhost/36935] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46453 2023-07-12 10:53:26,541 WARN [Listener at localhost/36731] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 10:53:26,586 WARN [Listener at localhost/36731] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 10:53:26,593 WARN [Listener at localhost/36731] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:26,602 INFO [Listener at localhost/36731] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:26,624 INFO [Listener at localhost/36731] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/java.io.tmpdir/Jetty_localhost_34927_datanode____.bdj0ik/webapp 2023-07-12 10:53:26,810 INFO [Listener at localhost/36731] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34927 2023-07-12 10:53:26,873 WARN [Listener at localhost/38383] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 10:53:26,996 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa7c81ca28a7567a2: Processing first storage report for DS-444808fc-217d-47e2-9131-ededad827df0 from datanode e330bc36-ab05-4539-9cc3-3850a5ee9264 2023-07-12 10:53:26,998 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa7c81ca28a7567a2: from storage DS-444808fc-217d-47e2-9131-ededad827df0 node DatanodeRegistration(127.0.0.1:45829, datanodeUuid=e330bc36-ab05-4539-9cc3-3850a5ee9264, infoPort=45645, infoSecurePort=0, ipcPort=36935, storageInfo=lv=-57;cid=testClusterID;nsid=179459615;c=1689159204177), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-12 10:53:26,999 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcc5ebd74e3f24768: Processing first storage report for DS-0cee4437-fdcf-4733-b0ad-75edf7c760bb from datanode d50ae1d8-690c-4b7d-a585-de840c0c4e36 2023-07-12 10:53:26,999 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcc5ebd74e3f24768: from storage DS-0cee4437-fdcf-4733-b0ad-75edf7c760bb node DatanodeRegistration(127.0.0.1:35415, datanodeUuid=d50ae1d8-690c-4b7d-a585-de840c0c4e36, infoPort=34473, infoSecurePort=0, ipcPort=36731, storageInfo=lv=-57;cid=testClusterID;nsid=179459615;c=1689159204177), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 10:53:26,999 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa7c81ca28a7567a2: Processing first storage report for DS-876c22fe-3b7e-4bbd-92a2-461746cf5153 from datanode e330bc36-ab05-4539-9cc3-3850a5ee9264 2023-07-12 10:53:26,999 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa7c81ca28a7567a2: from storage DS-876c22fe-3b7e-4bbd-92a2-461746cf5153 node DatanodeRegistration(127.0.0.1:45829, datanodeUuid=e330bc36-ab05-4539-9cc3-3850a5ee9264, infoPort=45645, infoSecurePort=0, ipcPort=36935, storageInfo=lv=-57;cid=testClusterID;nsid=179459615;c=1689159204177), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 10:53:26,999 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcc5ebd74e3f24768: Processing first storage report for DS-98100753-44db-4bb7-a22f-dcb41ee9b021 from datanode d50ae1d8-690c-4b7d-a585-de840c0c4e36 2023-07-12 10:53:26,999 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcc5ebd74e3f24768: from storage DS-98100753-44db-4bb7-a22f-dcb41ee9b021 node DatanodeRegistration(127.0.0.1:35415, datanodeUuid=d50ae1d8-690c-4b7d-a585-de840c0c4e36, infoPort=34473, infoSecurePort=0, ipcPort=36731, storageInfo=lv=-57;cid=testClusterID;nsid=179459615;c=1689159204177), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 10:53:27,069 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d63b9d60e31f1d7: Processing first storage report for DS-aea6ce4d-0b01-40c0-b605-0f8ccbf8e1eb from datanode 14598a12-3001-40cf-8d14-b421c7606a00 2023-07-12 10:53:27,069 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d63b9d60e31f1d7: from storage DS-aea6ce4d-0b01-40c0-b605-0f8ccbf8e1eb node DatanodeRegistration(127.0.0.1:46573, datanodeUuid=14598a12-3001-40cf-8d14-b421c7606a00, infoPort=44557, infoSecurePort=0, ipcPort=38383, storageInfo=lv=-57;cid=testClusterID;nsid=179459615;c=1689159204177), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 10:53:27,069 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d63b9d60e31f1d7: Processing first storage report for DS-229d42aa-fcac-4af0-a671-0b9abd15f9c0 from datanode 14598a12-3001-40cf-8d14-b421c7606a00 2023-07-12 10:53:27,069 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d63b9d60e31f1d7: from storage DS-229d42aa-fcac-4af0-a671-0b9abd15f9c0 node DatanodeRegistration(127.0.0.1:46573, datanodeUuid=14598a12-3001-40cf-8d14-b421c7606a00, infoPort=44557, infoSecurePort=0, ipcPort=38383, storageInfo=lv=-57;cid=testClusterID;nsid=179459615;c=1689159204177), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 10:53:27,306 DEBUG [Listener at localhost/38383] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7 2023-07-12 10:53:27,402 INFO [Listener at localhost/38383] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/zookeeper_0, clientPort=53362, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 10:53:27,419 INFO [Listener at localhost/38383] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53362 2023-07-12 10:53:27,429 INFO [Listener at localhost/38383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:27,431 INFO [Listener at localhost/38383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:28,104 INFO [Listener at localhost/38383] util.FSUtils(471): Created version file at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 with version=8 2023-07-12 10:53:28,104 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/hbase-staging 2023-07-12 10:53:28,459 INFO [Listener at localhost/38383] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 10:53:29,089 INFO [Listener at localhost/38383] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-12 10:53:29,129 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,129 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,130 INFO [Listener at localhost/38383] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 10:53:29,130 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,130 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 10:53:29,311 INFO [Listener at localhost/38383] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 10:53:29,391 DEBUG [Listener at localhost/38383] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 10:53:29,499 INFO [Listener at localhost/38383] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39303 2023-07-12 10:53:29,517 INFO [Listener at localhost/38383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,520 INFO [Listener at localhost/38383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,544 INFO [Listener at localhost/38383] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39303 connecting to ZooKeeper ensemble=127.0.0.1:53362 2023-07-12 10:53:29,595 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:393030x0, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 10:53:29,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39303-0x101591ccd770000 connected 2023-07-12 10:53:29,642 DEBUG [Listener at localhost/38383] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 10:53:29,642 DEBUG [Listener at localhost/38383] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:53:29,656 DEBUG [Listener at localhost/38383] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 10:53:29,666 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39303 2023-07-12 10:53:29,666 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39303 2023-07-12 10:53:29,667 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39303 2023-07-12 10:53:29,669 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39303 2023-07-12 10:53:29,669 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39303 2023-07-12 10:53:29,675 INFO [Listener at localhost/38383] master.HMaster(444): hbase.rootdir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648, hbase.cluster.distributed=false 2023-07-12 10:53:29,756 INFO [Listener at localhost/38383] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-12 10:53:29,756 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,756 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,756 INFO [Listener at localhost/38383] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 10:53:29,756 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,756 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 10:53:29,763 INFO [Listener at localhost/38383] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 10:53:29,767 INFO [Listener at localhost/38383] ipc.NettyRpcServer(120): Bind to /172.31.2.10:34083 2023-07-12 10:53:29,770 INFO [Listener at localhost/38383] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 10:53:29,778 INFO [Listener at localhost/38383] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 10:53:29,779 INFO [Listener at localhost/38383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,782 INFO [Listener at localhost/38383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,784 INFO [Listener at localhost/38383] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34083 connecting to ZooKeeper ensemble=127.0.0.1:53362 2023-07-12 10:53:29,789 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:340830x0, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 10:53:29,790 DEBUG [Listener at localhost/38383] zookeeper.ZKUtil(164): regionserver:340830x0, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 10:53:29,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34083-0x101591ccd770001 connected 2023-07-12 10:53:29,798 DEBUG [Listener at localhost/38383] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:53:29,799 DEBUG [Listener at localhost/38383] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 10:53:29,801 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34083 2023-07-12 10:53:29,802 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34083 2023-07-12 10:53:29,805 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34083 2023-07-12 10:53:29,807 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34083 2023-07-12 10:53:29,808 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34083 2023-07-12 10:53:29,822 INFO [Listener at localhost/38383] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-12 10:53:29,822 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,822 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,823 INFO [Listener at localhost/38383] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 10:53:29,823 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,823 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 10:53:29,823 INFO [Listener at localhost/38383] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 10:53:29,825 INFO [Listener at localhost/38383] ipc.NettyRpcServer(120): Bind to /172.31.2.10:36981 2023-07-12 10:53:29,825 INFO [Listener at localhost/38383] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 10:53:29,826 INFO [Listener at localhost/38383] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 10:53:29,827 INFO [Listener at localhost/38383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,829 INFO [Listener at localhost/38383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,831 INFO [Listener at localhost/38383] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36981 connecting to ZooKeeper ensemble=127.0.0.1:53362 2023-07-12 10:53:29,836 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:369810x0, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 10:53:29,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36981-0x101591ccd770002 connected 2023-07-12 10:53:29,837 DEBUG [Listener at localhost/38383] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 10:53:29,838 DEBUG [Listener at localhost/38383] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:53:29,839 DEBUG [Listener at localhost/38383] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 10:53:29,840 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36981 2023-07-12 10:53:29,840 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36981 2023-07-12 10:53:29,841 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36981 2023-07-12 10:53:29,841 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36981 2023-07-12 10:53:29,842 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36981 2023-07-12 10:53:29,855 INFO [Listener at localhost/38383] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-12 10:53:29,855 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,856 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,856 INFO [Listener at localhost/38383] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 10:53:29,856 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 10:53:29,856 INFO [Listener at localhost/38383] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 10:53:29,856 INFO [Listener at localhost/38383] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 10:53:29,857 INFO [Listener at localhost/38383] ipc.NettyRpcServer(120): Bind to /172.31.2.10:46191 2023-07-12 10:53:29,858 INFO [Listener at localhost/38383] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 10:53:29,859 INFO [Listener at localhost/38383] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 10:53:29,860 INFO [Listener at localhost/38383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,861 INFO [Listener at localhost/38383] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:29,862 INFO [Listener at localhost/38383] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46191 connecting to ZooKeeper ensemble=127.0.0.1:53362 2023-07-12 10:53:29,867 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:461910x0, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 10:53:29,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46191-0x101591ccd770003 connected 2023-07-12 10:53:29,868 DEBUG [Listener at localhost/38383] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 10:53:29,869 DEBUG [Listener at localhost/38383] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:53:29,869 DEBUG [Listener at localhost/38383] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 10:53:29,872 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46191 2023-07-12 10:53:29,873 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46191 2023-07-12 10:53:29,874 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46191 2023-07-12 10:53:29,876 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46191 2023-07-12 10:53:29,877 DEBUG [Listener at localhost/38383] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46191 2023-07-12 10:53:29,885 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,39303,1689159208284 2023-07-12 10:53:29,900 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 10:53:29,901 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,39303,1689159208284 2023-07-12 10:53:29,922 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 10:53:29,923 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:29,922 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 10:53:29,924 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 10:53:29,924 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 10:53:29,930 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 10:53:29,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 10:53:29,932 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,39303,1689159208284 from backup master directory 2023-07-12 10:53:29,936 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,39303,1689159208284 2023-07-12 10:53:29,937 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 10:53:29,938 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 10:53:29,939 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,39303,1689159208284 2023-07-12 10:53:29,943 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 10:53:29,945 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 10:53:30,068 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/hbase.id with ID: 86c330f0-5a3e-47a0-ad95-0149e0305e9e 2023-07-12 10:53:30,120 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 10:53:30,143 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:30,244 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1234113f to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:30,283 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c82938a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:30,311 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 10:53:30,312 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 10:53:30,338 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 10:53:30,338 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 10:53:30,340 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 10:53:30,345 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 10:53:30,346 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 10:53:30,384 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/MasterData/data/master/store-tmp 2023-07-12 10:53:30,446 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:30,447 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 10:53:30,447 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:53:30,447 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:53:30,447 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 10:53:30,447 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:53:30,447 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:53:30,448 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 10:53:30,450 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/MasterData/WALs/jenkins-hbase9.apache.org,39303,1689159208284 2023-07-12 10:53:30,478 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39303%2C1689159208284, suffix=, logDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/MasterData/WALs/jenkins-hbase9.apache.org,39303,1689159208284, archiveDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/MasterData/oldWALs, maxLogs=10 2023-07-12 10:53:30,564 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46573,DS-aea6ce4d-0b01-40c0-b605-0f8ccbf8e1eb,DISK] 2023-07-12 10:53:30,564 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45829,DS-444808fc-217d-47e2-9131-ededad827df0,DISK] 2023-07-12 10:53:30,564 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35415,DS-0cee4437-fdcf-4733-b0ad-75edf7c760bb,DISK] 2023-07-12 10:53:30,575 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 10:53:30,666 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/MasterData/WALs/jenkins-hbase9.apache.org,39303,1689159208284/jenkins-hbase9.apache.org%2C39303%2C1689159208284.1689159210492 2023-07-12 10:53:30,670 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35415,DS-0cee4437-fdcf-4733-b0ad-75edf7c760bb,DISK], DatanodeInfoWithStorage[127.0.0.1:45829,DS-444808fc-217d-47e2-9131-ededad827df0,DISK], DatanodeInfoWithStorage[127.0.0.1:46573,DS-aea6ce4d-0b01-40c0-b605-0f8ccbf8e1eb,DISK]] 2023-07-12 10:53:30,670 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 10:53:30,671 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:30,675 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 10:53:30,677 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 10:53:30,757 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 10:53:30,770 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 10:53:30,805 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 10:53:30,823 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:30,831 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 10:53:30,834 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 10:53:30,856 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 10:53:30,865 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:30,866 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59574717, jitterRate=-0.11226753890514374}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:30,867 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 10:53:30,868 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 10:53:30,900 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 10:53:30,900 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 10:53:30,904 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 10:53:30,906 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 10:53:30,958 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 52 msec 2023-07-12 10:53:30,959 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 10:53:30,994 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 10:53:31,001 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 10:53:31,029 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 10:53:31,036 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 10:53:31,038 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 10:53:31,047 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 10:53:31,053 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 10:53:31,061 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:31,064 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 10:53:31,068 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 10:53:31,086 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 10:53:31,094 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 10:53:31,094 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 10:53:31,095 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 10:53:31,095 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:31,095 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 10:53:31,098 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,39303,1689159208284, sessionid=0x101591ccd770000, setting cluster-up flag (Was=false) 2023-07-12 10:53:31,120 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:31,129 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 10:53:31,131 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,39303,1689159208284 2023-07-12 10:53:31,138 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:31,149 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 10:53:31,151 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,39303,1689159208284 2023-07-12 10:53:31,154 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp 2023-07-12 10:53:31,182 INFO [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(951): ClusterId : 86c330f0-5a3e-47a0-ad95-0149e0305e9e 2023-07-12 10:53:31,203 INFO [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(951): ClusterId : 86c330f0-5a3e-47a0-ad95-0149e0305e9e 2023-07-12 10:53:31,221 DEBUG [RS:0;jenkins-hbase9:34083] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 10:53:31,221 DEBUG [RS:1;jenkins-hbase9:36981] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 10:53:31,227 INFO [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(951): ClusterId : 86c330f0-5a3e-47a0-ad95-0149e0305e9e 2023-07-12 10:53:31,228 DEBUG [RS:2;jenkins-hbase9:46191] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 10:53:31,230 DEBUG [RS:1;jenkins-hbase9:36981] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 10:53:31,231 DEBUG [RS:1;jenkins-hbase9:36981] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 10:53:31,232 DEBUG [RS:0;jenkins-hbase9:34083] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 10:53:31,232 DEBUG [RS:0;jenkins-hbase9:34083] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 10:53:31,237 DEBUG [RS:2;jenkins-hbase9:46191] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 10:53:31,237 DEBUG [RS:2;jenkins-hbase9:46191] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 10:53:31,238 DEBUG [RS:0;jenkins-hbase9:34083] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 10:53:31,238 DEBUG [RS:1;jenkins-hbase9:36981] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 10:53:31,247 DEBUG [RS:1;jenkins-hbase9:36981] zookeeper.ReadOnlyZKClient(139): Connect 0x388187e2 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:31,247 DEBUG [RS:2;jenkins-hbase9:46191] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 10:53:31,241 DEBUG [RS:0;jenkins-hbase9:34083] zookeeper.ReadOnlyZKClient(139): Connect 0x09dfd553 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:31,275 DEBUG [RS:2;jenkins-hbase9:46191] zookeeper.ReadOnlyZKClient(139): Connect 0x351fe54d to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:31,303 DEBUG [RS:0;jenkins-hbase9:34083] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cfcba37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:31,304 DEBUG [RS:0;jenkins-hbase9:34083] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64c7e1f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-12 10:53:31,329 DEBUG [RS:1;jenkins-hbase9:36981] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46a981ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:31,330 DEBUG [RS:2;jenkins-hbase9:46191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bd81d9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:31,330 DEBUG [RS:1;jenkins-hbase9:36981] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40d64d40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-12 10:53:31,330 DEBUG [RS:2;jenkins-hbase9:46191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fe78e3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-12 10:53:31,348 DEBUG [RS:1;jenkins-hbase9:36981] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:36981 2023-07-12 10:53:31,348 DEBUG [RS:2;jenkins-hbase9:46191] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:46191 2023-07-12 10:53:31,356 INFO [RS:2;jenkins-hbase9:46191] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 10:53:31,356 INFO [RS:2;jenkins-hbase9:46191] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 10:53:31,357 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-12 10:53:31,363 DEBUG [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 10:53:31,364 INFO [RS:2;jenkins-hbase9:46191] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:31,365 DEBUG [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 10:53:31,366 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:31,366 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-12 10:53:31,366 INFO [RS:1;jenkins-hbase9:36981] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 10:53:31,367 INFO [RS:1;jenkins-hbase9:36981] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 10:53:31,367 DEBUG [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 10:53:31,367 INFO [RS:1;jenkins-hbase9:36981] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:31,367 DEBUG [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 10:53:31,370 INFO [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39303,1689159208284 with isa=jenkins-hbase9.apache.org/172.31.2.10:46191, startcode=1689159209855 2023-07-12 10:53:31,381 INFO [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39303,1689159208284 with isa=jenkins-hbase9.apache.org/172.31.2.10:36981, startcode=1689159209821 2023-07-12 10:53:31,381 DEBUG [RS:0;jenkins-hbase9:34083] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:34083 2023-07-12 10:53:31,381 INFO [RS:0;jenkins-hbase9:34083] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 10:53:31,381 INFO [RS:0;jenkins-hbase9:34083] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 10:53:31,381 DEBUG [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 10:53:31,382 INFO [RS:0;jenkins-hbase9:34083] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:31,382 DEBUG [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 10:53:31,383 INFO [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39303,1689159208284 with isa=jenkins-hbase9.apache.org/172.31.2.10:34083, startcode=1689159209755 2023-07-12 10:53:31,392 DEBUG [RS:1;jenkins-hbase9:36981] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 10:53:31,392 DEBUG [RS:2;jenkins-hbase9:46191] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 10:53:31,392 DEBUG [RS:0;jenkins-hbase9:34083] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 10:53:31,470 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39983, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 10:53:31,470 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42043, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 10:53:31,470 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40959, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 10:53:31,481 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39303] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 10:53:31,491 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39303] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 10:53:31,491 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 10:53:31,492 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39303] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 10:53:31,505 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-12 10:53:31,505 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-12 10:53:31,506 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-12 10:53:31,506 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-12 10:53:31,506 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-12 10:53:31,506 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,506 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-12 10:53:31,506 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,513 DEBUG [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 10:53:31,513 WARN [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 10:53:31,514 DEBUG [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 10:53:31,514 WARN [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 10:53:31,514 DEBUG [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 10:53:31,514 WARN [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 10:53:31,515 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689159241515 2023-07-12 10:53:31,518 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 10:53:31,524 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 10:53:31,525 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 10:53:31,530 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 10:53:31,533 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 10:53:31,542 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 10:53:31,543 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 10:53:31,543 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 10:53:31,544 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 10:53:31,544 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 10:53:31,548 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 10:53:31,548 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 10:53:31,558 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 10:53:31,559 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 10:53:31,561 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689159211560,5,FailOnTimeoutGroup] 2023-07-12 10:53:31,561 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689159211561,5,FailOnTimeoutGroup] 2023-07-12 10:53:31,562 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,562 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 10:53:31,564 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,564 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,597 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 10:53:31,600 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 10:53:31,600 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:53:31,615 INFO [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39303,1689159208284 with isa=jenkins-hbase9.apache.org/172.31.2.10:34083, startcode=1689159209755 2023-07-12 10:53:31,615 INFO [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39303,1689159208284 with isa=jenkins-hbase9.apache.org/172.31.2.10:36981, startcode=1689159209821 2023-07-12 10:53:31,615 INFO [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39303,1689159208284 with isa=jenkins-hbase9.apache.org/172.31.2.10:46191, startcode=1689159209855 2023-07-12 10:53:31,634 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39303] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:31,640 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39303] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:31,643 DEBUG [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:53:31,643 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39303] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:31,643 DEBUG [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:53:31,643 DEBUG [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44111 2023-07-12 10:53:31,643 DEBUG [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44111 2023-07-12 10:53:31,643 DEBUG [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 10:53:31,643 DEBUG [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 10:53:31,644 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:31,649 DEBUG [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:53:31,649 DEBUG [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44111 2023-07-12 10:53:31,649 DEBUG [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 10:53:31,651 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 10:53:31,653 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:53:31,655 DEBUG [RS:0;jenkins-hbase9:34083] zookeeper.ZKUtil(162): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:31,656 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/info 2023-07-12 10:53:31,655 DEBUG [RS:2;jenkins-hbase9:46191] zookeeper.ZKUtil(162): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:31,655 DEBUG [RS:1;jenkins-hbase9:36981] zookeeper.ZKUtil(162): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:31,658 WARN [RS:0;jenkins-hbase9:34083] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 10:53:31,658 INFO [RS:0;jenkins-hbase9:34083] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 10:53:31,658 DEBUG [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/WALs/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:31,659 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 10:53:31,658 WARN [RS:2;jenkins-hbase9:46191] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 10:53:31,658 WARN [RS:1;jenkins-hbase9:36981] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 10:53:31,666 INFO [RS:1;jenkins-hbase9:36981] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 10:53:31,666 DEBUG [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/WALs/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:31,667 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,34083,1689159209755] 2023-07-12 10:53:31,668 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,36981,1689159209821] 2023-07-12 10:53:31,668 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,46191,1689159209855] 2023-07-12 10:53:31,659 INFO [RS:2;jenkins-hbase9:46191] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 10:53:31,670 DEBUG [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/WALs/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:31,666 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:31,671 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 10:53:31,676 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/rep_barrier 2023-07-12 10:53:31,677 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 10:53:31,680 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:31,680 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 10:53:31,684 DEBUG [RS:1;jenkins-hbase9:36981] zookeeper.ZKUtil(162): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:31,684 DEBUG [RS:0;jenkins-hbase9:34083] zookeeper.ZKUtil(162): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:31,684 DEBUG [RS:2;jenkins-hbase9:46191] zookeeper.ZKUtil(162): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:31,685 DEBUG [RS:0;jenkins-hbase9:34083] zookeeper.ZKUtil(162): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:31,686 DEBUG [RS:1;jenkins-hbase9:36981] zookeeper.ZKUtil(162): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:31,685 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/table 2023-07-12 10:53:31,685 DEBUG [RS:2;jenkins-hbase9:46191] zookeeper.ZKUtil(162): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:31,686 DEBUG [RS:1;jenkins-hbase9:36981] zookeeper.ZKUtil(162): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:31,686 DEBUG [RS:0;jenkins-hbase9:34083] zookeeper.ZKUtil(162): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:31,687 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 10:53:31,691 DEBUG [RS:2;jenkins-hbase9:46191] zookeeper.ZKUtil(162): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:31,692 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:31,698 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740 2023-07-12 10:53:31,700 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740 2023-07-12 10:53:31,705 DEBUG [RS:0;jenkins-hbase9:34083] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 10:53:31,709 DEBUG [RS:2;jenkins-hbase9:46191] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 10:53:31,713 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 10:53:31,715 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 10:53:31,716 DEBUG [RS:1;jenkins-hbase9:36981] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 10:53:31,717 INFO [RS:2;jenkins-hbase9:46191] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 10:53:31,718 INFO [RS:1;jenkins-hbase9:36981] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 10:53:31,717 INFO [RS:0;jenkins-hbase9:34083] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 10:53:31,720 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:31,721 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75273713, jitterRate=0.12166573107242584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 10:53:31,721 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 10:53:31,721 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 10:53:31,721 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 10:53:31,721 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 10:53:31,721 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 10:53:31,721 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 10:53:31,730 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 10:53:31,731 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 10:53:31,737 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 10:53:31,738 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 10:53:31,749 INFO [RS:2;jenkins-hbase9:46191] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 10:53:31,749 INFO [RS:0;jenkins-hbase9:34083] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 10:53:31,749 INFO [RS:1;jenkins-hbase9:36981] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 10:53:31,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 10:53:31,756 INFO [RS:2;jenkins-hbase9:46191] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 10:53:31,756 INFO [RS:2;jenkins-hbase9:46191] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,757 INFO [RS:1;jenkins-hbase9:36981] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 10:53:31,757 INFO [RS:0;jenkins-hbase9:34083] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 10:53:31,767 INFO [RS:1;jenkins-hbase9:36981] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,767 INFO [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 10:53:31,767 INFO [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 10:53:31,767 INFO [RS:0;jenkins-hbase9:34083] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,768 INFO [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 10:53:31,780 INFO [RS:0;jenkins-hbase9:34083] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,780 INFO [RS:2;jenkins-hbase9:46191] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,780 INFO [RS:1;jenkins-hbase9:36981] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,781 DEBUG [RS:0;jenkins-hbase9:34083] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,781 DEBUG [RS:2;jenkins-hbase9:46191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,781 DEBUG [RS:0;jenkins-hbase9:34083] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,781 DEBUG [RS:2;jenkins-hbase9:46191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,781 DEBUG [RS:0;jenkins-hbase9:34083] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,782 DEBUG [RS:0;jenkins-hbase9:34083] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,782 DEBUG [RS:0;jenkins-hbase9:34083] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,782 DEBUG [RS:0;jenkins-hbase9:34083] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-12 10:53:31,782 DEBUG [RS:0;jenkins-hbase9:34083] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,782 DEBUG [RS:0;jenkins-hbase9:34083] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,783 DEBUG [RS:0;jenkins-hbase9:34083] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,783 DEBUG [RS:0;jenkins-hbase9:34083] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,783 DEBUG [RS:1;jenkins-hbase9:36981] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,783 DEBUG [RS:1;jenkins-hbase9:36981] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,783 DEBUG [RS:1;jenkins-hbase9:36981] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,783 DEBUG [RS:1;jenkins-hbase9:36981] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,783 DEBUG [RS:1;jenkins-hbase9:36981] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,784 DEBUG [RS:1;jenkins-hbase9:36981] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-12 10:53:31,784 DEBUG [RS:1;jenkins-hbase9:36981] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,784 DEBUG [RS:1;jenkins-hbase9:36981] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,784 DEBUG [RS:1;jenkins-hbase9:36981] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,786 DEBUG [RS:1;jenkins-hbase9:36981] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,793 DEBUG [RS:2;jenkins-hbase9:46191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,793 DEBUG [RS:2;jenkins-hbase9:46191] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,793 DEBUG [RS:2;jenkins-hbase9:46191] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,793 DEBUG [RS:2;jenkins-hbase9:46191] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-12 10:53:31,793 DEBUG [RS:2;jenkins-hbase9:46191] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,793 DEBUG [RS:2;jenkins-hbase9:46191] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,794 DEBUG [RS:2;jenkins-hbase9:46191] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,794 DEBUG [RS:2;jenkins-hbase9:46191] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-12 10:53:31,797 INFO [RS:2;jenkins-hbase9:46191] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,798 INFO [RS:2;jenkins-hbase9:46191] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,798 INFO [RS:2;jenkins-hbase9:46191] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,801 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 10:53:31,802 INFO [RS:0;jenkins-hbase9:34083] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,802 INFO [RS:0;jenkins-hbase9:34083] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,803 INFO [RS:0;jenkins-hbase9:34083] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,816 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 10:53:31,826 INFO [RS:1;jenkins-hbase9:36981] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,826 INFO [RS:1;jenkins-hbase9:36981] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,826 INFO [RS:1;jenkins-hbase9:36981] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,845 INFO [RS:2;jenkins-hbase9:46191] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 10:53:31,849 INFO [RS:2;jenkins-hbase9:46191] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,46191,1689159209855-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,849 INFO [RS:0;jenkins-hbase9:34083] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 10:53:31,854 INFO [RS:0;jenkins-hbase9:34083] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34083,1689159209755-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,864 INFO [RS:1;jenkins-hbase9:36981] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 10:53:31,864 INFO [RS:1;jenkins-hbase9:36981] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36981,1689159209821-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:31,897 INFO [RS:0;jenkins-hbase9:34083] regionserver.Replication(203): jenkins-hbase9.apache.org,34083,1689159209755 started 2023-07-12 10:53:31,897 INFO [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,34083,1689159209755, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:34083, sessionid=0x101591ccd770001 2023-07-12 10:53:31,899 INFO [RS:1;jenkins-hbase9:36981] regionserver.Replication(203): jenkins-hbase9.apache.org,36981,1689159209821 started 2023-07-12 10:53:31,899 INFO [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,36981,1689159209821, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:36981, sessionid=0x101591ccd770002 2023-07-12 10:53:31,899 DEBUG [RS:1;jenkins-hbase9:36981] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 10:53:31,899 DEBUG [RS:1;jenkins-hbase9:36981] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:31,900 DEBUG [RS:1;jenkins-hbase9:36981] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,36981,1689159209821' 2023-07-12 10:53:31,900 DEBUG [RS:1;jenkins-hbase9:36981] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 10:53:31,900 DEBUG [RS:1;jenkins-hbase9:36981] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 10:53:31,901 DEBUG [RS:1;jenkins-hbase9:36981] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 10:53:31,901 DEBUG [RS:1;jenkins-hbase9:36981] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 10:53:31,901 DEBUG [RS:1;jenkins-hbase9:36981] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:31,902 DEBUG [RS:1;jenkins-hbase9:36981] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,36981,1689159209821' 2023-07-12 10:53:31,902 DEBUG [RS:1;jenkins-hbase9:36981] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:31,902 DEBUG [RS:1;jenkins-hbase9:36981] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:31,903 DEBUG [RS:1;jenkins-hbase9:36981] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 10:53:31,903 INFO [RS:1;jenkins-hbase9:36981] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 10:53:31,904 INFO [RS:1;jenkins-hbase9:36981] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 10:53:31,907 INFO [RS:2;jenkins-hbase9:46191] regionserver.Replication(203): jenkins-hbase9.apache.org,46191,1689159209855 started 2023-07-12 10:53:31,907 INFO [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,46191,1689159209855, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:46191, sessionid=0x101591ccd770003 2023-07-12 10:53:31,907 DEBUG [RS:2;jenkins-hbase9:46191] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 10:53:31,908 DEBUG [RS:2;jenkins-hbase9:46191] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:31,908 DEBUG [RS:2;jenkins-hbase9:46191] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46191,1689159209855' 2023-07-12 10:53:31,909 DEBUG [RS:2;jenkins-hbase9:46191] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 10:53:31,911 DEBUG [RS:0;jenkins-hbase9:34083] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 10:53:31,912 DEBUG [RS:0;jenkins-hbase9:34083] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:31,912 DEBUG [RS:0;jenkins-hbase9:34083] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,34083,1689159209755' 2023-07-12 10:53:31,912 DEBUG [RS:0;jenkins-hbase9:34083] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 10:53:31,912 DEBUG [RS:2;jenkins-hbase9:46191] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 10:53:31,913 DEBUG [RS:2;jenkins-hbase9:46191] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 10:53:31,913 DEBUG [RS:2;jenkins-hbase9:46191] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 10:53:31,913 DEBUG [RS:0;jenkins-hbase9:34083] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 10:53:31,913 DEBUG [RS:2;jenkins-hbase9:46191] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:31,914 DEBUG [RS:2;jenkins-hbase9:46191] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46191,1689159209855' 2023-07-12 10:53:31,914 DEBUG [RS:2;jenkins-hbase9:46191] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:31,914 DEBUG [RS:2;jenkins-hbase9:46191] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:31,915 DEBUG [RS:0;jenkins-hbase9:34083] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 10:53:31,915 DEBUG [RS:0;jenkins-hbase9:34083] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 10:53:31,915 DEBUG [RS:0;jenkins-hbase9:34083] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:31,915 DEBUG [RS:0;jenkins-hbase9:34083] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,34083,1689159209755' 2023-07-12 10:53:31,915 DEBUG [RS:0;jenkins-hbase9:34083] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:31,915 DEBUG [RS:2;jenkins-hbase9:46191] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 10:53:31,915 INFO [RS:2;jenkins-hbase9:46191] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 10:53:31,916 INFO [RS:2;jenkins-hbase9:46191] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 10:53:31,917 DEBUG [RS:0;jenkins-hbase9:34083] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:31,917 DEBUG [RS:0;jenkins-hbase9:34083] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 10:53:31,917 INFO [RS:0;jenkins-hbase9:34083] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 10:53:31,917 INFO [RS:0;jenkins-hbase9:34083] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 10:53:31,978 DEBUG [jenkins-hbase9:39303] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 10:53:31,983 DEBUG [jenkins-hbase9:39303] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:53:31,992 DEBUG [jenkins-hbase9:39303] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:53:31,992 DEBUG [jenkins-hbase9:39303] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:53:31,992 DEBUG [jenkins-hbase9:39303] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:53:31,992 DEBUG [jenkins-hbase9:39303] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:53:31,996 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,36981,1689159209821, state=OPENING 2023-07-12 10:53:32,003 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 10:53:32,005 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:32,005 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 10:53:32,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,36981,1689159209821}] 2023-07-12 10:53:32,015 INFO [RS:1;jenkins-hbase9:36981] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C36981%2C1689159209821, suffix=, logDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/WALs/jenkins-hbase9.apache.org,36981,1689159209821, archiveDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/oldWALs, maxLogs=32 2023-07-12 10:53:32,021 INFO [RS:2;jenkins-hbase9:46191] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C46191%2C1689159209855, suffix=, logDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/WALs/jenkins-hbase9.apache.org,46191,1689159209855, archiveDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/oldWALs, maxLogs=32 2023-07-12 10:53:32,023 INFO [RS:0;jenkins-hbase9:34083] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C34083%2C1689159209755, suffix=, logDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/WALs/jenkins-hbase9.apache.org,34083,1689159209755, archiveDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/oldWALs, maxLogs=32 2023-07-12 10:53:32,078 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35415,DS-0cee4437-fdcf-4733-b0ad-75edf7c760bb,DISK] 2023-07-12 10:53:32,079 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46573,DS-aea6ce4d-0b01-40c0-b605-0f8ccbf8e1eb,DISK] 2023-07-12 10:53:32,079 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45829,DS-444808fc-217d-47e2-9131-ededad827df0,DISK] 2023-07-12 10:53:32,095 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45829,DS-444808fc-217d-47e2-9131-ededad827df0,DISK] 2023-07-12 10:53:32,095 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46573,DS-aea6ce4d-0b01-40c0-b605-0f8ccbf8e1eb,DISK] 2023-07-12 10:53:32,098 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35415,DS-0cee4437-fdcf-4733-b0ad-75edf7c760bb,DISK] 2023-07-12 10:53:32,098 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35415,DS-0cee4437-fdcf-4733-b0ad-75edf7c760bb,DISK] 2023-07-12 10:53:32,099 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46573,DS-aea6ce4d-0b01-40c0-b605-0f8ccbf8e1eb,DISK] 2023-07-12 10:53:32,099 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45829,DS-444808fc-217d-47e2-9131-ededad827df0,DISK] 2023-07-12 10:53:32,111 INFO [RS:1;jenkins-hbase9:36981] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/WALs/jenkins-hbase9.apache.org,36981,1689159209821/jenkins-hbase9.apache.org%2C36981%2C1689159209821.1689159212017 2023-07-12 10:53:32,111 INFO [RS:0;jenkins-hbase9:34083] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/WALs/jenkins-hbase9.apache.org,34083,1689159209755/jenkins-hbase9.apache.org%2C34083%2C1689159209755.1689159212025 2023-07-12 10:53:32,114 DEBUG [RS:1;jenkins-hbase9:36981] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46573,DS-aea6ce4d-0b01-40c0-b605-0f8ccbf8e1eb,DISK], DatanodeInfoWithStorage[127.0.0.1:45829,DS-444808fc-217d-47e2-9131-ededad827df0,DISK], DatanodeInfoWithStorage[127.0.0.1:35415,DS-0cee4437-fdcf-4733-b0ad-75edf7c760bb,DISK]] 2023-07-12 10:53:32,117 DEBUG [RS:0;jenkins-hbase9:34083] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46573,DS-aea6ce4d-0b01-40c0-b605-0f8ccbf8e1eb,DISK], DatanodeInfoWithStorage[127.0.0.1:45829,DS-444808fc-217d-47e2-9131-ededad827df0,DISK], DatanodeInfoWithStorage[127.0.0.1:35415,DS-0cee4437-fdcf-4733-b0ad-75edf7c760bb,DISK]] 2023-07-12 10:53:32,122 INFO [RS:2;jenkins-hbase9:46191] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/WALs/jenkins-hbase9.apache.org,46191,1689159209855/jenkins-hbase9.apache.org%2C46191%2C1689159209855.1689159212025 2023-07-12 10:53:32,126 DEBUG [RS:2;jenkins-hbase9:46191] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35415,DS-0cee4437-fdcf-4733-b0ad-75edf7c760bb,DISK], DatanodeInfoWithStorage[127.0.0.1:46573,DS-aea6ce4d-0b01-40c0-b605-0f8ccbf8e1eb,DISK], DatanodeInfoWithStorage[127.0.0.1:45829,DS-444808fc-217d-47e2-9131-ededad827df0,DISK]] 2023-07-12 10:53:32,299 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:32,302 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 10:53:32,307 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 10:53:32,319 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 10:53:32,320 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 10:53:32,323 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C36981%2C1689159209821.meta, suffix=.meta, logDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/WALs/jenkins-hbase9.apache.org,36981,1689159209821, archiveDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/oldWALs, maxLogs=32 2023-07-12 10:53:32,342 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45829,DS-444808fc-217d-47e2-9131-ededad827df0,DISK] 2023-07-12 10:53:32,343 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46573,DS-aea6ce4d-0b01-40c0-b605-0f8ccbf8e1eb,DISK] 2023-07-12 10:53:32,345 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35415,DS-0cee4437-fdcf-4733-b0ad-75edf7c760bb,DISK] 2023-07-12 10:53:32,352 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/WALs/jenkins-hbase9.apache.org,36981,1689159209821/jenkins-hbase9.apache.org%2C36981%2C1689159209821.meta.1689159212324.meta 2023-07-12 10:53:32,354 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45829,DS-444808fc-217d-47e2-9131-ededad827df0,DISK], DatanodeInfoWithStorage[127.0.0.1:46573,DS-aea6ce4d-0b01-40c0-b605-0f8ccbf8e1eb,DISK], DatanodeInfoWithStorage[127.0.0.1:35415,DS-0cee4437-fdcf-4733-b0ad-75edf7c760bb,DISK]] 2023-07-12 10:53:32,354 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 10:53:32,355 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-12 10:53:32,356 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:32,357 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 10:53:32,362 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 10:53:32,364 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 10:53:32,383 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 10:53:32,383 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:32,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 10:53:32,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 10:53:32,387 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 10:53:32,391 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/info 2023-07-12 10:53:32,391 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/info 2023-07-12 10:53:32,392 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 10:53:32,393 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:32,393 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 10:53:32,395 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/rep_barrier 2023-07-12 10:53:32,395 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/rep_barrier 2023-07-12 10:53:32,395 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 10:53:32,396 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:32,397 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 10:53:32,398 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/table 2023-07-12 10:53:32,398 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/table 2023-07-12 10:53:32,399 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 10:53:32,400 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:32,402 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740 2023-07-12 10:53:32,406 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740 2023-07-12 10:53:32,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 10:53:32,413 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 10:53:32,415 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69105484, jitterRate=0.029751956462860107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 10:53:32,418 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 10:53:32,430 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689159212287 2023-07-12 10:53:32,450 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,36981,1689159209821, state=OPEN 2023-07-12 10:53:32,452 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 10:53:32,454 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 10:53:32,454 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 10:53:32,454 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 10:53:32,461 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 10:53:32,461 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,36981,1689159209821 in 444 msec 2023-07-12 10:53:32,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 10:53:32,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 709 msec 2023-07-12 10:53:32,495 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1000 sec 2023-07-12 10:53:32,495 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689159212495, completionTime=-1 2023-07-12 10:53:32,495 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 10:53:32,496 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 10:53:32,594 DEBUG [hconnection-0x4d4dea46-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:32,605 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:32,632 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 10:53:32,632 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689159272632 2023-07-12 10:53:32,632 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689159332632 2023-07-12 10:53:32,632 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 136 msec 2023-07-12 10:53:32,662 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39303,1689159208284-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:32,662 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39303,1689159208284-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:32,662 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39303,1689159208284-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:32,665 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:39303, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:32,666 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 10:53:32,675 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 10:53:32,690 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 10:53:32,691 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 10:53:32,710 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 10:53:32,713 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:53:32,722 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:53:32,752 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/hbase/namespace/8782dc4ac9c7873d9ae66891c63ddb6f 2023-07-12 10:53:32,755 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/hbase/namespace/8782dc4ac9c7873d9ae66891c63ddb6f empty. 2023-07-12 10:53:32,756 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/hbase/namespace/8782dc4ac9c7873d9ae66891c63ddb6f 2023-07-12 10:53:32,756 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 10:53:32,817 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 10:53:32,820 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8782dc4ac9c7873d9ae66891c63ddb6f, NAME => 'hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:53:32,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:32,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 8782dc4ac9c7873d9ae66891c63ddb6f, disabling compactions & flushes 2023-07-12 10:53:32,850 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. 2023-07-12 10:53:32,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. 2023-07-12 10:53:32,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. after waiting 0 ms 2023-07-12 10:53:32,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. 2023-07-12 10:53:32,850 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. 2023-07-12 10:53:32,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 8782dc4ac9c7873d9ae66891c63ddb6f: 2023-07-12 10:53:32,858 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:53:32,878 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689159212861"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159212861"}]},"ts":"1689159212861"} 2023-07-12 10:53:32,914 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 10:53:32,916 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:53:32,923 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159212917"}]},"ts":"1689159212917"} 2023-07-12 10:53:32,927 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 10:53:32,932 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:53:32,933 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:53:32,933 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:53:32,933 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:53:32,934 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:53:32,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8782dc4ac9c7873d9ae66891c63ddb6f, ASSIGN}] 2023-07-12 10:53:32,939 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8782dc4ac9c7873d9ae66891c63ddb6f, ASSIGN 2023-07-12 10:53:32,942 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8782dc4ac9c7873d9ae66891c63ddb6f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36981,1689159209821; forceNewPlan=false, retain=false 2023-07-12 10:53:33,095 INFO [jenkins-hbase9:39303] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 10:53:33,097 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8782dc4ac9c7873d9ae66891c63ddb6f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:33,097 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689159213096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159213096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159213096"}]},"ts":"1689159213096"} 2023-07-12 10:53:33,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8782dc4ac9c7873d9ae66891c63ddb6f, server=jenkins-hbase9.apache.org,36981,1689159209821}] 2023-07-12 10:53:33,263 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. 2023-07-12 10:53:33,264 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8782dc4ac9c7873d9ae66891c63ddb6f, NAME => 'hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f.', STARTKEY => '', ENDKEY => ''} 2023-07-12 10:53:33,264 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. service=AccessControlService 2023-07-12 10:53:33,265 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:33,266 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8782dc4ac9c7873d9ae66891c63ddb6f 2023-07-12 10:53:33,266 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:33,266 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8782dc4ac9c7873d9ae66891c63ddb6f 2023-07-12 10:53:33,266 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8782dc4ac9c7873d9ae66891c63ddb6f 2023-07-12 10:53:33,268 INFO [StoreOpener-8782dc4ac9c7873d9ae66891c63ddb6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8782dc4ac9c7873d9ae66891c63ddb6f 2023-07-12 10:53:33,271 DEBUG [StoreOpener-8782dc4ac9c7873d9ae66891c63ddb6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/namespace/8782dc4ac9c7873d9ae66891c63ddb6f/info 2023-07-12 10:53:33,271 DEBUG [StoreOpener-8782dc4ac9c7873d9ae66891c63ddb6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/namespace/8782dc4ac9c7873d9ae66891c63ddb6f/info 2023-07-12 10:53:33,271 INFO [StoreOpener-8782dc4ac9c7873d9ae66891c63ddb6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8782dc4ac9c7873d9ae66891c63ddb6f columnFamilyName info 2023-07-12 10:53:33,272 INFO [StoreOpener-8782dc4ac9c7873d9ae66891c63ddb6f-1] regionserver.HStore(310): Store=8782dc4ac9c7873d9ae66891c63ddb6f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:33,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/namespace/8782dc4ac9c7873d9ae66891c63ddb6f 2023-07-12 10:53:33,275 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/namespace/8782dc4ac9c7873d9ae66891c63ddb6f 2023-07-12 10:53:33,280 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8782dc4ac9c7873d9ae66891c63ddb6f 2023-07-12 10:53:33,283 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/namespace/8782dc4ac9c7873d9ae66891c63ddb6f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:33,284 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8782dc4ac9c7873d9ae66891c63ddb6f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69454633, jitterRate=0.03495468199253082}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:33,284 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8782dc4ac9c7873d9ae66891c63ddb6f: 2023-07-12 10:53:33,287 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f., pid=6, masterSystemTime=1689159213257 2023-07-12 10:53:33,291 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. 2023-07-12 10:53:33,291 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. 2023-07-12 10:53:33,292 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8782dc4ac9c7873d9ae66891c63ddb6f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:33,292 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689159213292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159213292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159213292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159213292"}]},"ts":"1689159213292"} 2023-07-12 10:53:33,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 10:53:33,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8782dc4ac9c7873d9ae66891c63ddb6f, server=jenkins-hbase9.apache.org,36981,1689159209821 in 197 msec 2023-07-12 10:53:33,307 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 10:53:33,307 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8782dc4ac9c7873d9ae66891c63ddb6f, ASSIGN in 366 msec 2023-07-12 10:53:33,309 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:53:33,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159213309"}]},"ts":"1689159213309"} 2023-07-12 10:53:33,311 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 10:53:33,315 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 10:53:33,317 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 10:53:33,317 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:33,317 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:53:33,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 626 msec 2023-07-12 10:53:33,358 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 10:53:33,393 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 10:53:33,400 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 51 msec 2023-07-12 10:53:33,409 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 10:53:33,423 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 10:53:33,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-12 10:53:33,437 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 10:53:33,439 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 10:53:33,439 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.500sec 2023-07-12 10:53:33,442 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 10:53:33,444 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 10:53:33,444 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 10:53:33,446 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39303,1689159208284-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 10:53:33,446 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39303,1689159208284-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 10:53:33,467 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 10:53:33,470 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-12 10:53:33,472 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:53:33,474 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:53:33,478 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-12 10:53:33,479 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/hbase/acl/afa78ab2e1f54be524e7eda1c8b899f9 2023-07-12 10:53:33,481 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/hbase/acl/afa78ab2e1f54be524e7eda1c8b899f9 empty. 2023-07-12 10:53:33,484 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/hbase/acl/afa78ab2e1f54be524e7eda1c8b899f9 2023-07-12 10:53:33,484 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-12 10:53:33,496 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 10:53:33,530 DEBUG [Listener at localhost/38383] zookeeper.ReadOnlyZKClient(139): Connect 0x416d673c to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:33,571 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-12 10:53:33,573 DEBUG [Listener at localhost/38383] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d40e34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:33,586 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => afa78ab2e1f54be524e7eda1c8b899f9, NAME => 'hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:53:33,601 DEBUG [hconnection-0x46f19b93-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:33,601 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 10:53:33,629 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:33,629 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing afa78ab2e1f54be524e7eda1c8b899f9, disabling compactions & flushes 2023-07-12 10:53:33,629 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. 2023-07-12 10:53:33,629 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. 2023-07-12 10:53:33,629 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. after waiting 0 ms 2023-07-12 10:53:33,629 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. 2023-07-12 10:53:33,629 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. 2023-07-12 10:53:33,629 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for afa78ab2e1f54be524e7eda1c8b899f9: 2023-07-12 10:53:33,635 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:53:33,635 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:33,639 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689159213638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159213638"}]},"ts":"1689159213638"} 2023-07-12 10:53:33,639 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,39303,1689159208284 2023-07-12 10:53:33,639 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-12 10:53:33,639 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/test.cache.data in system properties and HBase conf 2023-07-12 10:53:33,640 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 10:53:33,640 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/hadoop.log.dir in system properties and HBase conf 2023-07-12 10:53:33,640 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 10:53:33,640 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 10:53:33,640 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 10:53:33,640 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 10:53:33,640 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 10:53:33,641 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 10:53:33,641 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 10:53:33,641 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 10:53:33,641 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 10:53:33,641 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 10:53:33,641 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 10:53:33,641 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 10:53:33,641 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/nfs.dump.dir in system properties and HBase conf 2023-07-12 10:53:33,642 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/java.io.tmpdir in system properties and HBase conf 2023-07-12 10:53:33,642 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 10:53:33,642 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 10:53:33,642 INFO [Listener at localhost/38383] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-12 10:53:33,645 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 10:53:33,646 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:53:33,647 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159213647"}]},"ts":"1689159213647"} 2023-07-12 10:53:33,649 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-12 10:53:33,656 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:53:33,657 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:53:33,658 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:53:33,658 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:53:33,658 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:53:33,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=afa78ab2e1f54be524e7eda1c8b899f9, ASSIGN}] 2023-07-12 10:53:33,662 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=afa78ab2e1f54be524e7eda1c8b899f9, ASSIGN 2023-07-12 10:53:33,665 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=afa78ab2e1f54be524e7eda1c8b899f9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46191,1689159209855; forceNewPlan=false, retain=false 2023-07-12 10:53:33,845 INFO [jenkins-hbase9:39303] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 10:53:33,845 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 10:53:33,847 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=afa78ab2e1f54be524e7eda1c8b899f9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:33,847 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689159213847"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159213847"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159213847"}]},"ts":"1689159213847"} 2023-07-12 10:53:33,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure afa78ab2e1f54be524e7eda1c8b899f9, server=jenkins-hbase9.apache.org,46191,1689159209855}] 2023-07-12 10:53:34,014 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:34,014 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 10:53:34,022 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 10:53:34,028 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. 2023-07-12 10:53:34,029 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => afa78ab2e1f54be524e7eda1c8b899f9, NAME => 'hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9.', STARTKEY => '', ENDKEY => ''} 2023-07-12 10:53:34,029 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. service=AccessControlService 2023-07-12 10:53:34,029 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:34,030 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl afa78ab2e1f54be524e7eda1c8b899f9 2023-07-12 10:53:34,030 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:34,030 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for afa78ab2e1f54be524e7eda1c8b899f9 2023-07-12 10:53:34,030 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for afa78ab2e1f54be524e7eda1c8b899f9 2023-07-12 10:53:34,037 INFO [StoreOpener-afa78ab2e1f54be524e7eda1c8b899f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region afa78ab2e1f54be524e7eda1c8b899f9 2023-07-12 10:53:34,042 DEBUG [StoreOpener-afa78ab2e1f54be524e7eda1c8b899f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/acl/afa78ab2e1f54be524e7eda1c8b899f9/l 2023-07-12 10:53:34,042 DEBUG [StoreOpener-afa78ab2e1f54be524e7eda1c8b899f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/acl/afa78ab2e1f54be524e7eda1c8b899f9/l 2023-07-12 10:53:34,043 INFO [StoreOpener-afa78ab2e1f54be524e7eda1c8b899f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afa78ab2e1f54be524e7eda1c8b899f9 columnFamilyName l 2023-07-12 10:53:34,045 INFO [StoreOpener-afa78ab2e1f54be524e7eda1c8b899f9-1] regionserver.HStore(310): Store=afa78ab2e1f54be524e7eda1c8b899f9/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:34,050 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/acl/afa78ab2e1f54be524e7eda1c8b899f9 2023-07-12 10:53:34,052 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/acl/afa78ab2e1f54be524e7eda1c8b899f9 2023-07-12 10:53:34,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for afa78ab2e1f54be524e7eda1c8b899f9 2023-07-12 10:53:34,080 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/acl/afa78ab2e1f54be524e7eda1c8b899f9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:34,081 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened afa78ab2e1f54be524e7eda1c8b899f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68238497, jitterRate=0.01683284342288971}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:34,082 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for afa78ab2e1f54be524e7eda1c8b899f9: 2023-07-12 10:53:34,090 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9., pid=11, masterSystemTime=1689159214014 2023-07-12 10:53:34,096 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. 2023-07-12 10:53:34,097 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=afa78ab2e1f54be524e7eda1c8b899f9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:34,097 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689159214097"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159214097"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159214097"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159214097"}]},"ts":"1689159214097"} 2023-07-12 10:53:34,098 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. 2023-07-12 10:53:34,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 10:53:34,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure afa78ab2e1f54be524e7eda1c8b899f9, server=jenkins-hbase9.apache.org,46191,1689159209855 in 246 msec 2023-07-12 10:53:34,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 10:53:34,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=afa78ab2e1f54be524e7eda1c8b899f9, ASSIGN in 448 msec 2023-07-12 10:53:34,112 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:53:34,112 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159214112"}]},"ts":"1689159214112"} 2023-07-12 10:53:34,126 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-12 10:53:34,130 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:53:34,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 662 msec 2023-07-12 10:53:34,147 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 10:53:34,147 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-12 10:53:34,170 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 10:53:34,880 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:35,205 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:35,210 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_33695_jobhistory____ynbofq/webapp 2023-07-12 10:53:35,371 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-12 10:53:35,371 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-12 10:53:35,371 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 10:53:35,374 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 10:53:35,438 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:35,711 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:36,109 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-12 10:53:36,158 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:33695 2023-07-12 10:53:36,368 WARN [Listener at jenkins-hbase9.apache.org/39645] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:36,734 WARN [Listener at jenkins-hbase9.apache.org/39645] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 10:53:36,735 INFO [Listener at jenkins-hbase9.apache.org/39645] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:36,743 INFO [Listener at jenkins-hbase9.apache.org/39645] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_41663_cluster____.nsbz3h/webapp 2023-07-12 10:53:36,823 INFO [Listener at jenkins-hbase9.apache.org/39645] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 10:53:36,823 INFO [Listener at jenkins-hbase9.apache.org/39645] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-12 10:53:36,823 INFO [Listener at jenkins-hbase9.apache.org/39645] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 10:53:36,824 INFO [Listener at jenkins-hbase9.apache.org/39645] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 10:53:36,833 INFO [Listener at jenkins-hbase9.apache.org/39645] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:37,045 INFO [Listener at jenkins-hbase9.apache.org/39645] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:37,226 INFO [Listener at jenkins-hbase9.apache.org/39645] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:37,284 INFO [Listener at jenkins-hbase9.apache.org/39645] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:41663 2023-07-12 10:53:38,005 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:53:38,195 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-12 10:53:38,197 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 10:53:38,198 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 10:53:38,221 WARN [Listener at jenkins-hbase9.apache.org/43965] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:38,259 WARN [Listener at jenkins-hbase9.apache.org/43965] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 10:53:38,259 INFO [Listener at jenkins-hbase9.apache.org/43965] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:38,273 INFO [Listener at jenkins-hbase9.apache.org/43965] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_33739_node____1pyza/webapp 2023-07-12 10:53:38,324 INFO [Listener at jenkins-hbase9.apache.org/43965] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 10:53:38,324 INFO [Listener at jenkins-hbase9.apache.org/43965] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 10:53:38,325 INFO [Listener at jenkins-hbase9.apache.org/43965] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 10:53:38,325 INFO [Listener at jenkins-hbase9.apache.org/43965] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 10:53:38,332 INFO [Listener at jenkins-hbase9.apache.org/43965] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:38,351 INFO [Listener at jenkins-hbase9.apache.org/43965] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:38,455 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:53:38,455 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-12 10:53:38,456 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:53:38,456 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-12 10:53:38,457 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 10:53:38,457 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-12 10:53:38,457 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:53:38,457 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-12 10:53:38,457 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 10:53:38,457 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 10:53:38,464 INFO [Listener at jenkins-hbase9.apache.org/43965] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:38,504 INFO [Listener at jenkins-hbase9.apache.org/43965] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:33739 2023-07-12 10:53:38,767 WARN [Listener at jenkins-hbase9.apache.org/45227] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 10:53:38,775 WARN [Listener at jenkins-hbase9.apache.org/45227] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 10:53:38,775 INFO [Listener at jenkins-hbase9.apache.org/45227] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 10:53:38,781 INFO [Listener at jenkins-hbase9.apache.org/45227] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_46511_node____mjr3fw/webapp 2023-07-12 10:53:38,836 INFO [Listener at jenkins-hbase9.apache.org/45227] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 10:53:38,837 INFO [Listener at jenkins-hbase9.apache.org/45227] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 10:53:38,837 INFO [Listener at jenkins-hbase9.apache.org/45227] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 10:53:38,837 INFO [Listener at jenkins-hbase9.apache.org/45227] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 10:53:38,846 INFO [Listener at jenkins-hbase9.apache.org/45227] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:38,859 INFO [Listener at jenkins-hbase9.apache.org/45227] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:38,945 INFO [Listener at jenkins-hbase9.apache.org/45227] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 10:53:38,951 INFO [Listener at jenkins-hbase9.apache.org/45227] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:46511 2023-07-12 10:53:38,970 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-12 10:53:38,972 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:53:39,035 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=385, ProcessCount=172, AvailableMemoryMB=8241 2023-07-12 10:53:39,035 WARN [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-12 10:53:39,050 DEBUG [Listener at jenkins-hbase9.apache.org/45227] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 10:53:39,056 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 10:53:39,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 10:53:39,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:39,069 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:53:39,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-12 10:53:39,072 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:53:39,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 10:53:39,077 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999 2023-07-12 10:53:39,080 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999 empty. 2023-07-12 10:53:39,083 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999 2023-07-12 10:53:39,083 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce 2023-07-12 10:53:39,083 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce empty. 2023-07-12 10:53:39,093 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce 2023-07-12 10:53:39,094 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 10:53:39,128 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-12 10:53:39,130 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 759bcf47a7c810b80c1720452f097999, NAME => 'testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:53:39,130 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 00740a6609474f010aacebbedbfa9fce, NAME => 'testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:53:39,170 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:39,171 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 759bcf47a7c810b80c1720452f097999, disabling compactions & flushes 2023-07-12 10:53:39,172 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:39,172 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:39,172 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. after waiting 0 ms 2023-07-12 10:53:39,172 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:39,172 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:39,172 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 759bcf47a7c810b80c1720452f097999: 2023-07-12 10:53:39,177 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:39,178 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 00740a6609474f010aacebbedbfa9fce, disabling compactions & flushes 2023-07-12 10:53:39,178 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:39,178 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:39,178 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. after waiting 0 ms 2023-07-12 10:53:39,179 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:39,179 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:39,179 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 00740a6609474f010aacebbedbfa9fce: 2023-07-12 10:53:39,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 10:53:39,187 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:53:39,188 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159219188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159219188"}]},"ts":"1689159219188"} 2023-07-12 10:53:39,189 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159219188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159219188"}]},"ts":"1689159219188"} 2023-07-12 10:53:39,259 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:53:39,260 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:53:39,261 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159219260"}]},"ts":"1689159219260"} 2023-07-12 10:53:39,263 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-12 10:53:39,269 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:53:39,271 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:53:39,272 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:53:39,272 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:53:39,272 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:53:39,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759bcf47a7c810b80c1720452f097999, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=00740a6609474f010aacebbedbfa9fce, ASSIGN}] 2023-07-12 10:53:39,276 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759bcf47a7c810b80c1720452f097999, ASSIGN 2023-07-12 10:53:39,276 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=00740a6609474f010aacebbedbfa9fce, ASSIGN 2023-07-12 10:53:39,278 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759bcf47a7c810b80c1720452f097999, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34083,1689159209755; forceNewPlan=false, retain=false 2023-07-12 10:53:39,278 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=00740a6609474f010aacebbedbfa9fce, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36981,1689159209821; forceNewPlan=false, retain=false 2023-07-12 10:53:39,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 10:53:39,428 INFO [jenkins-hbase9:39303] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:53:39,432 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=00740a6609474f010aacebbedbfa9fce, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:39,432 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=759bcf47a7c810b80c1720452f097999, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:39,432 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159219432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159219432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159219432"}]},"ts":"1689159219432"} 2023-07-12 10:53:39,432 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159219432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159219432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159219432"}]},"ts":"1689159219432"} 2023-07-12 10:53:39,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 00740a6609474f010aacebbedbfa9fce, server=jenkins-hbase9.apache.org,36981,1689159209821}] 2023-07-12 10:53:39,437 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 759bcf47a7c810b80c1720452f097999, server=jenkins-hbase9.apache.org,34083,1689159209755}] 2023-07-12 10:53:39,590 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:39,590 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 10:53:39,594 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 10:53:39,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:39,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 00740a6609474f010aacebbedbfa9fce, NAME => 'testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 10:53:39,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. service=AccessControlService 2023-07-12 10:53:39,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:39,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:39,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 759bcf47a7c810b80c1720452f097999, NAME => 'testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 10:53:39,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 00740a6609474f010aacebbedbfa9fce 2023-07-12 10:53:39,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:39,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 00740a6609474f010aacebbedbfa9fce 2023-07-12 10:53:39,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. service=AccessControlService 2023-07-12 10:53:39,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 00740a6609474f010aacebbedbfa9fce 2023-07-12 10:53:39,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:39,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 759bcf47a7c810b80c1720452f097999 2023-07-12 10:53:39,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:39,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 759bcf47a7c810b80c1720452f097999 2023-07-12 10:53:39,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 759bcf47a7c810b80c1720452f097999 2023-07-12 10:53:39,603 INFO [StoreOpener-00740a6609474f010aacebbedbfa9fce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 00740a6609474f010aacebbedbfa9fce 2023-07-12 10:53:39,603 INFO [StoreOpener-759bcf47a7c810b80c1720452f097999-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 759bcf47a7c810b80c1720452f097999 2023-07-12 10:53:39,605 DEBUG [StoreOpener-00740a6609474f010aacebbedbfa9fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/cf 2023-07-12 10:53:39,605 DEBUG [StoreOpener-759bcf47a7c810b80c1720452f097999-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/cf 2023-07-12 10:53:39,605 DEBUG [StoreOpener-00740a6609474f010aacebbedbfa9fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/cf 2023-07-12 10:53:39,605 DEBUG [StoreOpener-759bcf47a7c810b80c1720452f097999-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/cf 2023-07-12 10:53:39,609 INFO [StoreOpener-759bcf47a7c810b80c1720452f097999-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 759bcf47a7c810b80c1720452f097999 columnFamilyName cf 2023-07-12 10:53:39,610 INFO [StoreOpener-00740a6609474f010aacebbedbfa9fce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00740a6609474f010aacebbedbfa9fce columnFamilyName cf 2023-07-12 10:53:39,613 INFO [StoreOpener-00740a6609474f010aacebbedbfa9fce-1] regionserver.HStore(310): Store=00740a6609474f010aacebbedbfa9fce/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:39,613 INFO [StoreOpener-759bcf47a7c810b80c1720452f097999-1] regionserver.HStore(310): Store=759bcf47a7c810b80c1720452f097999/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:39,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999 2023-07-12 10:53:39,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce 2023-07-12 10:53:39,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce 2023-07-12 10:53:39,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999 2023-07-12 10:53:39,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 759bcf47a7c810b80c1720452f097999 2023-07-12 10:53:39,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 00740a6609474f010aacebbedbfa9fce 2023-07-12 10:53:39,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:39,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 00740a6609474f010aacebbedbfa9fce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74938301, jitterRate=0.11666770279407501}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:39,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 00740a6609474f010aacebbedbfa9fce: 2023-07-12 10:53:39,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:39,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce., pid=15, masterSystemTime=1689159219589 2023-07-12 10:53:39,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 759bcf47a7c810b80c1720452f097999; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64762290, jitterRate=-0.03496667742729187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:39,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 759bcf47a7c810b80c1720452f097999: 2023-07-12 10:53:39,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:39,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:39,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999., pid=16, masterSystemTime=1689159219590 2023-07-12 10:53:39,648 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=00740a6609474f010aacebbedbfa9fce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:39,649 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159219648"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159219648"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159219648"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159219648"}]},"ts":"1689159219648"} 2023-07-12 10:53:39,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:39,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:39,653 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=759bcf47a7c810b80c1720452f097999, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:39,656 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159219653"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159219653"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159219653"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159219653"}]},"ts":"1689159219653"} 2023-07-12 10:53:39,662 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-12 10:53:39,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 00740a6609474f010aacebbedbfa9fce, server=jenkins-hbase9.apache.org,36981,1689159209821 in 222 msec 2023-07-12 10:53:39,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-12 10:53:39,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 759bcf47a7c810b80c1720452f097999, server=jenkins-hbase9.apache.org,34083,1689159209755 in 224 msec 2023-07-12 10:53:39,667 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=00740a6609474f010aacebbedbfa9fce, ASSIGN in 391 msec 2023-07-12 10:53:39,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-12 10:53:39,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759bcf47a7c810b80c1720452f097999, ASSIGN in 395 msec 2023-07-12 10:53:39,673 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:53:39,673 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159219673"}]},"ts":"1689159219673"} 2023-07-12 10:53:39,677 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-12 10:53:39,681 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:53:39,688 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-12 10:53:39,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 10:53:39,697 DEBUG [PEWorker-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:39,701 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:39,706 DEBUG [hconnection-0x10f04809-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:39,709 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-12 10:53:39,720 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 10:53:39,761 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:39,761 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:39,761 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:39,761 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:39,761 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:53:39,769 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:39,769 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:39,769 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:39,769 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:39,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 707 msec 2023-07-12 10:53:40,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 10:53:40,193 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-12 10:53:40,196 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 10:53:40,197 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:40,200 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:53:40,224 DEBUG [hconnection-0x46f19b93-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:40,229 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:40,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 10:53:40,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159220249 (current time:1689159220249). 2023-07-12 10:53:40,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:53:40,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x4acfca39 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:40,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17c92b8f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:40,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:40,264 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:40,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4acfca39 to 127.0.0.1:53362 2023-07-12 10:53:40,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:40,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x4f40cf7f to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:40,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10a71a74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:40,373 DEBUG [hconnection-0x4fa44d99-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:40,374 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:40,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:40,381 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:40,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f40cf7f to 127.0.0.1:53362 2023-07-12 10:53:40,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:40,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 10:53:40,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:53:40,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 10:53:40,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 10:53:40,444 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 10:53:40,452 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689159820452 2023-07-12 10:53:40,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 10:53:40,452 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 10:53:40,459 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 10:53:40,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 10:53:40,464 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:53:40,464 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:53:40,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 26 msec 2023-07-12 10:53:40,466 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 10:53:40,467 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689159820467 2023-07-12 10:53:40,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,510 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-12 10:53:40,510 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:40,511 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 10:53:40,511 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 10:53:40,512 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,512 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,518 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:40,518 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:40,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:40,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:40,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:40,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:40,519 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:40,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:40,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:40,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 10:53:40,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 10:53:40,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,527 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 10:53:40,527 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,527 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,527 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 10:53:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 10:53:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,530 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 10:53:40,531 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,531 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,532 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,532 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:53:40,533 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,535 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 10:53:40,535 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:40,537 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 10:53:40,537 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 10:53:40,537 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 10:53:40,537 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 10:53:40,537 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,537 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:40,540 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 10:53:40,540 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 10:53:40,540 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:40,540 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 10:53:40,540 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 10:53:40,540 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 10:53:40,541 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 10:53:40,541 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 10:53:40,541 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,541 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:40,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:40,541 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,541 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:40,542 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,542 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,542 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:40,543 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,543 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:40,543 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,543 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:40,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:40,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:40,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 10:53:40,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51de22b0[Count = 1] remaining members to acquire global barrier 2023-07-12 10:53:40,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:40,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:40,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:40,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:40,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:40,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:40,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 10:53:40,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51de22b0[Count = 0] remaining members to acquire global barrier 2023-07-12 10:53:40,552 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 10:53:40,553 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,555 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,555 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,555 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,556 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 10:53:40,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,556 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 10:53:40,556 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 10:53:40,556 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,556 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 10:53:40,556 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,46191,1689159209855' in zk 2023-07-12 10:53:40,558 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,558 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:53:40,563 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:40,563 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:40,563 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:40,563 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:40,563 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:40,563 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:40,563 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 10:53:40,563 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:40,563 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 10:53:40,565 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:40,565 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. started... 2023-07-12 10:53:40,565 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. started... 2023-07-12 10:53:40,568 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 759bcf47a7c810b80c1720452f097999: 2023-07-12 10:53:40,568 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 00740a6609474f010aacebbedbfa9fce: 2023-07-12 10:53:40,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 10:53:40,569 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,569 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:40,571 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:53:40,575 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:40,575 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:40,580 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:53:40,580 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:53:40,622 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. completed. 2023-07-12 10:53:40,622 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:40,622 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:40,623 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:40,623 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,628 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 10:53:40,628 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,36981,1689159209821' in zk 2023-07-12 10:53:40,632 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 10:53:40,632 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:40,632 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 10:53:40,636 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:40,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:40,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:40,637 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. completed. 2023-07-12 10:53:40,637 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:40,637 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:40,637 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:40,637 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,637 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 10:53:40,637 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,34083,1689159209755' in zk 2023-07-12 10:53:40,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:40,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,639 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 10:53:40,639 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,640 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:40,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,640 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 10:53:40,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:40,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:40,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:40,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,36981,1689159209821': 2023-07-12 10:53:40,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 10:53:40,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:40,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:40,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:40,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:40,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:40,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:40,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:40,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,34083,1689159209755': 2023-07-12 10:53:40,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 10:53:40,653 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-12 10:53:40,653 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:53:40,653 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:53:40,653 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,653 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:53:40,657 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,657 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:40,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:40,657 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:40,657 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,657 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,657 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:40,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,658 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:40,658 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:40,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:40,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:40,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:40,659 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,659 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:40,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:40,662 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:40,663 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,663 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:40,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:40,681 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:40,681 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,681 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,681 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:40,681 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:40,681 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:40,681 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:40,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:40,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:40,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:40,681 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:40,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:40,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:40,682 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:40,682 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,681 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:40,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 10:53:40,681 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,683 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:40,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:40,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 10:53:40,683 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:40,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:40,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:40,683 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,683 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:40,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:40,683 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:40,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:40,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:40,683 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,684 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 10:53:40,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,771 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:40,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 10:53:40,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:40,773 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:53:40,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,839 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 10:53:40,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,839 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:40,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689159220452Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689159220724 (+272 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689159220724Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689159220725 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689159220742 (+17 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689159220779 (+37 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689159220839 (+60 ms) 2023-07-12 10:53:40,842 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 10:53:40,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 387 msec 2023-07-12 10:53:41,073 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:41,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 10:53:41,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:53:41,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34083] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:53:41,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36981] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:53:41,104 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 10:53:41,104 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:41,104 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:53:41,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 10:53:41,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159221121 (current time:1689159221121). 2023-07-12 10:53:41,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:53:41,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x62ad4067 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:41,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e0f38d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:41,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:41,142 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:41,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62ad4067 to 127.0.0.1:53362 2023-07-12 10:53:41,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:41,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x281ba359 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:41,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20bd7045, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:41,157 DEBUG [hconnection-0x17431d21-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:41,161 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:41,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:41,169 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:41,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x281ba359 to 127.0.0.1:53362 2023-07-12 10:53:41,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:41,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 10:53:41,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:53:41,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 10:53:41,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 10:53:41,179 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 10:53:41,181 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689159821181 2023-07-12 10:53:41,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 10:53:41,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 10:53:41,183 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:53:41,183 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:53:41,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 10:53:41,185 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 10:53:41,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 9 msec 2023-07-12 10:53:41,189 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 10:53:41,190 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689159821190 2023-07-12 10:53:41,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-12 10:53:41,214 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-12 10:53:41,214 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:41,215 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 10:53:41,215 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 10:53:41,215 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,215 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,217 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:41,217 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:41,217 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:41,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:41,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:41,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:41,217 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:41,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:41,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:41,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,218 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,218 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,219 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,219 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:53:41,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 10:53:41,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 10:53:41,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 10:53:41,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 10:53:41,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 10:53:41,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 10:53:41,219 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 10:53:41,220 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 10:53:41,220 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:41,221 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 10:53:41,221 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 10:53:41,221 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 10:53:41,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 10:53:41,221 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 10:53:41,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 10:53:41,221 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:41,221 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 10:53:41,222 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:41,222 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 10:53:41,223 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 10:53:41,223 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 10:53:41,223 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 10:53:41,224 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 10:53:41,224 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 10:53:41,225 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,225 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:41,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:41,226 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,226 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:41,227 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,233 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,234 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,233 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,234 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:41,234 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:41,234 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:41,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:41,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:41,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 10:53:41,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@385cba3d[Count = 1] remaining members to acquire global barrier 2023-07-12 10:53:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:41,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:41,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:41,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:41,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 10:53:41,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@385cba3d[Count = 0] remaining members to acquire global barrier 2023-07-12 10:53:41,239 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 10:53:41,239 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,244 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,244 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,244 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 10:53:41,244 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,244 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,244 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:41,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,244 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 10:53:41,244 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 10:53:41,244 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,46191,1689159209855' in zk 2023-07-12 10:53:41,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,244 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:41,244 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:41,244 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. started... 2023-07-12 10:53:41,244 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 10:53:41,245 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 759bcf47a7c810b80c1720452f097999 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-12 10:53:41,245 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,245 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:53:41,245 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:41,245 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:41,245 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:41,246 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. started... 2023-07-12 10:53:41,246 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 00740a6609474f010aacebbedbfa9fce 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-12 10:53:41,248 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 10:53:41,248 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:41,248 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 10:53:41,283 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:41,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 10:53:41,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:41,285 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:53:41,401 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307128da1620d70484398beaaa5c7fea289a3 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307128da1620d70484398beaaa5c7fea289a3 2023-07-12 10:53:41,401 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307127eef8f76c57049d39aa3a435e307fe67 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307127eef8f76c57049d39aa3a435e307fe67 2023-07-12 10:53:41,451 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/.tmp/cf/83c1bb7d8499421392b960e17121e01c 2023-07-12 10:53:41,455 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/.tmp/cf/e8ecee300a8a4e10a590c59c4525e7a3 2023-07-12 10:53:41,469 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/.tmp/cf/e8ecee300a8a4e10a590c59c4525e7a3 as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/cf/e8ecee300a8a4e10a590c59c4525e7a3 2023-07-12 10:53:41,471 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/.tmp/cf/83c1bb7d8499421392b960e17121e01c as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/cf/83c1bb7d8499421392b960e17121e01c 2023-07-12 10:53:41,480 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/cf/83c1bb7d8499421392b960e17121e01c, entries=2, sequenceid=6, filesize=5.2 K 2023-07-12 10:53:41,482 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/cf/e8ecee300a8a4e10a590c59c4525e7a3, entries=48, sequenceid=6, filesize=13.0 K 2023-07-12 10:53:41,483 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 759bcf47a7c810b80c1720452f097999 in 238ms, sequenceid=6, compaction requested=false 2023-07-12 10:53:41,485 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 10:53:41,485 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:41,485 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 759bcf47a7c810b80c1720452f097999: 2023-07-12 10:53:41,486 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 00740a6609474f010aacebbedbfa9fce in 240ms, sequenceid=6, compaction requested=false 2023-07-12 10:53:41,486 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 10:53:41,487 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 00740a6609474f010aacebbedbfa9fce: 2023-07-12 10:53:41,487 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:41,487 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/cf/83c1bb7d8499421392b960e17121e01c] hfiles 2023-07-12 10:53:41,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 10:53:41,487 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/cf/83c1bb7d8499421392b960e17121e01c for snapshot=snaptb0-testExportWithTargetName 2023-07-12 10:53:41,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:41,487 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 10:53:41,488 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:41,488 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/cf/e8ecee300a8a4e10a590c59c4525e7a3] hfiles 2023-07-12 10:53:41,488 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/cf/e8ecee300a8a4e10a590c59c4525e7a3 for snapshot=snaptb0-testExportWithTargetName 2023-07-12 10:53:41,488 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:53:41,531 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. completed. 2023-07-12 10:53:41,531 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:41,531 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:41,531 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:41,531 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,532 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 10:53:41,532 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,36981,1689159209821' in zk 2023-07-12 10:53:41,534 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 10:53:41,534 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,534 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:41,534 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 10:53:41,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:41,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:41,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:41,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:41,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:41,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:41,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,36981,1689159209821': 2023-07-12 10:53:41,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 10:53:41,788 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:41,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 10:53:41,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:41,790 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 10:53:41,933 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. completed. 2023-07-12 10:53:41,933 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:41,933 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:41,933 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:41,933 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,934 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 10:53:41,934 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,34083,1689159209755' in zk 2023-07-12 10:53:41,937 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,937 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 10:53:41,937 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:41,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:41,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:41,937 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 10:53:41,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:41,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:41,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:41,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:41,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:41,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,34083,1689159209755': 2023-07-12 10:53:41,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 10:53:41,944 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-12 10:53:41,944 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:53:41,944 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:53:41,944 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-12 10:53:41,944 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:53:41,947 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,947 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,947 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,947 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,947 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:41,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:41,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:41,947 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:41,947 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:41,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:41,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:41,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:41,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:41,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:41,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:41,948 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:41,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,949 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:41,949 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:41,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:41,952 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 10:53:41,953 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,955 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:41,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:41,974 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:41,974 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:41,974 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:41,974 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-12 10:53:41,978 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:41,978 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:41,974 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:41,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:41,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:41,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:41,978 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:41,978 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:41,978 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,979 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,979 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,979 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,979 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:41,979 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,979 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:41,979 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:41,979 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,979 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 10:53:41,978 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 10:53:41,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:41,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:41,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 10:53:41,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 10:53:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:41,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:41,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:41,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307127eef8f76c57049d39aa3a435e307fe67, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307128da1620d70484398beaaa5c7fea289a3] mob files 2023-07-12 10:53:41,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307127eef8f76c57049d39aa3a435e307fe67 2023-07-12 10:53:41,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307128da1620d70484398beaaa5c7fea289a3 2023-07-12 10:53:42,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-12 10:53:42,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 10:53:42,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 10:53:42,115 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 10:53:42,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 10:53:42,116 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 10:53:42,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689159221181Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689159222029 (+848 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689159222029Loading Region manifests for snaptb0-testExportWithTargetName at 1689159222029Writing data manifest for snaptb0-testExportWithTargetName at 1689159222039 (+10 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689159222064 (+25 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689159222115 (+51 ms) 2023-07-12 10:53:42,117 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 10:53:42,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 936 msec 2023-07-12 10:53:42,291 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:42,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 10:53:42,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:53:42,294 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159222294 2023-07-12 10:53:42,295 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44111, tgtDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159222294, rawTgtDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159222294, srcFsUri=hdfs://localhost:44111, srcDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:53:42,358 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:53:42,358 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1263882502_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159222294, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159222294/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 10:53:42,358 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648, snapshotDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-12 10:53:42,397 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159222294/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 10:53:42,532 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:42,533 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:42,533 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:42,534 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:42,534 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:42,535 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:42,535 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:42,640 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/hadoop-7439380258395380834.jar 2023-07-12 10:53:42,641 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:42,641 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:42,642 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:42,642 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:42,643 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:42,643 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:53:42,644 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:53:42,644 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:53:42,645 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:53:42,645 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:53:42,646 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:53:42,646 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:53:42,647 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:53:42,647 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:53:42,648 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:53:42,649 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:53:42,652 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:53:42,653 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:53:42,653 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:53:42,653 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:53:42,654 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:53:42,654 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:53:42,654 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:53:43,992 WARN [Listener at jenkins-hbase9.apache.org/45227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:53:43,998 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-12 10:53:44,009 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 10:53:44,533 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:53:44,534 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:53:44,829 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0001_000001 (auth:SIMPLE) 2023-07-12 10:53:45,107 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:53:50,066 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0001_000001 (auth:SIMPLE) 2023-07-12 10:53:52,315 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0001_000001 (auth:SIMPLE) 2023-07-12 10:53:55,727 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0001_000001 (auth:SIMPLE) 2023-07-12 10:53:56,960 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:53:56,963 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:53:56,974 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-12 10:53:56,974 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:53:56,975 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:53:56,975 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_272028698_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 10:53:56,976 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-12 10:53:56,976 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-12 10:53:56,976 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_272028698_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159222294/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159222294/.hbase-snapshot/testExportWithTargetName 2023-07-12 10:53:56,976 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159222294/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-12 10:53:56,976 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159222294/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-12 10:53:56,986 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-12 10:53:56,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-07-12 10:53:56,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,004 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159237004"}]},"ts":"1689159237004"} 2023-07-12 10:53:57,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 10:53:57,006 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-12 10:53:57,007 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-12 10:53:57,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759bcf47a7c810b80c1720452f097999, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=00740a6609474f010aacebbedbfa9fce, UNASSIGN}] 2023-07-12 10:53:57,011 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759bcf47a7c810b80c1720452f097999, UNASSIGN 2023-07-12 10:53:57,011 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=00740a6609474f010aacebbedbfa9fce, UNASSIGN 2023-07-12 10:53:57,012 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=759bcf47a7c810b80c1720452f097999, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:57,012 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=00740a6609474f010aacebbedbfa9fce, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:57,013 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159237012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159237012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159237012"}]},"ts":"1689159237012"} 2023-07-12 10:53:57,013 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159237012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159237012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159237012"}]},"ts":"1689159237012"} 2023-07-12 10:53:57,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 759bcf47a7c810b80c1720452f097999, server=jenkins-hbase9.apache.org,34083,1689159209755}] 2023-07-12 10:53:57,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 00740a6609474f010aacebbedbfa9fce, server=jenkins-hbase9.apache.org,36981,1689159209821}] 2023-07-12 10:53:57,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 10:53:57,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 759bcf47a7c810b80c1720452f097999 2023-07-12 10:53:57,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 00740a6609474f010aacebbedbfa9fce 2023-07-12 10:53:57,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 759bcf47a7c810b80c1720452f097999, disabling compactions & flushes 2023-07-12 10:53:57,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 00740a6609474f010aacebbedbfa9fce, disabling compactions & flushes 2023-07-12 10:53:57,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:57,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:57,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:57,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:57,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. after waiting 0 ms 2023-07-12 10:53:57,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:57,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. after waiting 0 ms 2023-07-12 10:53:57,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:57,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:53:57,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:53:57,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:53:57,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:53:57,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999. 2023-07-12 10:53:57,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce. 2023-07-12 10:53:57,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 759bcf47a7c810b80c1720452f097999: 2023-07-12 10:53:57,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 00740a6609474f010aacebbedbfa9fce: 2023-07-12 10:53:57,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 00740a6609474f010aacebbedbfa9fce 2023-07-12 10:53:57,199 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=00740a6609474f010aacebbedbfa9fce, regionState=CLOSED 2023-07-12 10:53:57,199 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159237199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159237199"}]},"ts":"1689159237199"} 2023-07-12 10:53:57,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 759bcf47a7c810b80c1720452f097999 2023-07-12 10:53:57,200 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=759bcf47a7c810b80c1720452f097999, regionState=CLOSED 2023-07-12 10:53:57,200 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689159237200"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159237200"}]},"ts":"1689159237200"} 2023-07-12 10:53:57,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-12 10:53:57,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 00740a6609474f010aacebbedbfa9fce, server=jenkins-hbase9.apache.org,36981,1689159209821 in 186 msec 2023-07-12 10:53:57,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-12 10:53:57,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 759bcf47a7c810b80c1720452f097999, server=jenkins-hbase9.apache.org,34083,1689159209755 in 188 msec 2023-07-12 10:53:57,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=00740a6609474f010aacebbedbfa9fce, UNASSIGN in 196 msec 2023-07-12 10:53:57,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-12 10:53:57,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=759bcf47a7c810b80c1720452f097999, UNASSIGN in 196 msec 2023-07-12 10:53:57,209 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159237209"}]},"ts":"1689159237209"} 2023-07-12 10:53:57,210 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-12 10:53:57,212 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-12 10:53:57,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 219 msec 2023-07-12 10:53:57,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 10:53:57,308 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-12 10:53:57,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-07-12 10:53:57,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,324 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-12 10:53:57,326 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,330 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-12 10:53:57,333 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999 2023-07-12 10:53:57,334 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce 2023-07-12 10:53:57,334 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,334 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,334 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,334 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,336 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 10:53:57,336 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 10:53:57,336 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 10:53:57,337 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,337 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,337 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 10:53:57,337 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:57,337 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:57,337 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:57,337 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 10:53:57,337 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 10:53:57,337 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:57,338 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/recovered.edits] 2023-07-12 10:53:57,338 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/recovered.edits] 2023-07-12 10:53:57,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 10:53:57,347 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/cf/e8ecee300a8a4e10a590c59c4525e7a3 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/cf/e8ecee300a8a4e10a590c59c4525e7a3 2023-07-12 10:53:57,347 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/cf/83c1bb7d8499421392b960e17121e01c to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/cf/83c1bb7d8499421392b960e17121e01c 2023-07-12 10:53:57,351 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/recovered.edits/9.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999/recovered.edits/9.seqid 2023-07-12 10:53:57,351 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/recovered.edits/9.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce/recovered.edits/9.seqid 2023-07-12 10:53:57,352 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/759bcf47a7c810b80c1720452f097999 2023-07-12 10:53:57,352 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportWithTargetName/00740a6609474f010aacebbedbfa9fce 2023-07-12 10:53:57,352 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 10:53:57,353 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 10:53:57,354 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-12 10:53:57,358 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307127eef8f76c57049d39aa3a435e307fe67 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307127eef8f76c57049d39aa3a435e307fe67 2023-07-12 10:53:57,359 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307128da1620d70484398beaaa5c7fea289a3 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307128da1620d70484398beaaa5c7fea289a3 2023-07-12 10:53:57,360 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 10:53:57,363 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,389 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-12 10:53:57,392 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-12 10:53:57,394 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,394 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-12 10:53:57,394 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159237394"}]},"ts":"9223372036854775807"} 2023-07-12 10:53:57,394 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159237394"}]},"ts":"9223372036854775807"} 2023-07-12 10:53:57,397 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 10:53:57,397 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 759bcf47a7c810b80c1720452f097999, NAME => 'testtb-testExportWithTargetName,,1689159219062.759bcf47a7c810b80c1720452f097999.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 00740a6609474f010aacebbedbfa9fce, NAME => 'testtb-testExportWithTargetName,1,1689159219062.00740a6609474f010aacebbedbfa9fce.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 10:53:57,397 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-12 10:53:57,397 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159237397"}]},"ts":"9223372036854775807"} 2023-07-12 10:53:57,399 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-12 10:53:57,402 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 10:53:57,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 88 msec 2023-07-12 10:53:57,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 10:53:57,444 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-12 10:53:57,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-12 10:53:57,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-12 10:53:57,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-07-12 10:53:57,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-12 10:53:57,538 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 706) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase9.apache.org/172.31.2.10:42617 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase9.apache.org/172.31.2.10:34051 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_177042301_1 at /127.0.0.1:52546 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:43072 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:52582 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:44598 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=532 (was 385) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=6428 (was 8241) 2023-07-12 10:53:57,538 WARN [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-12 10:53:57,562 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=532, ProcessCount=178, AvailableMemoryMB=6428 2023-07-12 10:53:57,562 WARN [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-12 10:53:57,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 10:53:57,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:53:57,573 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:53:57,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-12 10:53:57,580 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:53:57,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 10:53:57,594 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840 2023-07-12 10:53:57,604 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4 2023-07-12 10:53:57,604 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840 empty. 2023-07-12 10:53:57,605 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840 2023-07-12 10:53:57,605 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4 empty. 2023-07-12 10:53:57,606 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4 2023-07-12 10:53:57,606 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 10:53:57,643 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 10:53:57,647 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => ff97a258bc92c801021043e37c2141a4, NAME => 'testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:53:57,647 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b1a402c89b036415b368ef29d979b840, NAME => 'testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:53:57,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:57,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing ff97a258bc92c801021043e37c2141a4, disabling compactions & flushes 2023-07-12 10:53:57,676 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:53:57,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:53:57,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. after waiting 0 ms 2023-07-12 10:53:57,676 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:53:57,677 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:53:57,677 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for ff97a258bc92c801021043e37c2141a4: 2023-07-12 10:53:57,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 10:53:57,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 10:53:58,076 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:58,077 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b1a402c89b036415b368ef29d979b840, disabling compactions & flushes 2023-07-12 10:53:58,077 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:53:58,077 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:53:58,077 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. after waiting 0 ms 2023-07-12 10:53:58,077 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:53:58,077 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:53:58,077 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b1a402c89b036415b368ef29d979b840: 2023-07-12 10:53:58,080 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:53:58,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159238081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159238081"}]},"ts":"1689159238081"} 2023-07-12 10:53:58,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159238081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159238081"}]},"ts":"1689159238081"} 2023-07-12 10:53:58,083 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:53:58,084 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:53:58,085 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159238084"}]},"ts":"1689159238084"} 2023-07-12 10:53:58,086 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 10:53:58,090 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:53:58,091 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:53:58,091 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:53:58,091 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:53:58,091 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:53:58,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b1a402c89b036415b368ef29d979b840, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ff97a258bc92c801021043e37c2141a4, ASSIGN}] 2023-07-12 10:53:58,094 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ff97a258bc92c801021043e37c2141a4, ASSIGN 2023-07-12 10:53:58,094 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b1a402c89b036415b368ef29d979b840, ASSIGN 2023-07-12 10:53:58,095 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ff97a258bc92c801021043e37c2141a4, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46191,1689159209855; forceNewPlan=false, retain=false 2023-07-12 10:53:58,095 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b1a402c89b036415b368ef29d979b840, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34083,1689159209755; forceNewPlan=false, retain=false 2023-07-12 10:53:58,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 10:53:58,246 INFO [jenkins-hbase9:39303] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:53:58,248 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b1a402c89b036415b368ef29d979b840, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:58,248 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ff97a258bc92c801021043e37c2141a4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:58,249 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159238248"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159238248"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159238248"}]},"ts":"1689159238248"} 2023-07-12 10:53:58,249 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159238248"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159238248"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159238248"}]},"ts":"1689159238248"} 2023-07-12 10:53:58,251 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure b1a402c89b036415b368ef29d979b840, server=jenkins-hbase9.apache.org,34083,1689159209755}] 2023-07-12 10:53:58,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure ff97a258bc92c801021043e37c2141a4, server=jenkins-hbase9.apache.org,46191,1689159209855}] 2023-07-12 10:53:58,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:53:58,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1a402c89b036415b368ef29d979b840, NAME => 'testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 10:53:58,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. service=AccessControlService 2023-07-12 10:53:58,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:58,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b1a402c89b036415b368ef29d979b840 2023-07-12 10:53:58,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:58,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for b1a402c89b036415b368ef29d979b840 2023-07-12 10:53:58,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for b1a402c89b036415b368ef29d979b840 2023-07-12 10:53:58,415 INFO [StoreOpener-b1a402c89b036415b368ef29d979b840-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b1a402c89b036415b368ef29d979b840 2023-07-12 10:53:58,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:53:58,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff97a258bc92c801021043e37c2141a4, NAME => 'testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 10:53:58,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. service=AccessControlService 2023-07-12 10:53:58,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:53:58,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState ff97a258bc92c801021043e37c2141a4 2023-07-12 10:53:58,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:53:58,417 DEBUG [StoreOpener-b1a402c89b036415b368ef29d979b840-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/cf 2023-07-12 10:53:58,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ff97a258bc92c801021043e37c2141a4 2023-07-12 10:53:58,417 DEBUG [StoreOpener-b1a402c89b036415b368ef29d979b840-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/cf 2023-07-12 10:53:58,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ff97a258bc92c801021043e37c2141a4 2023-07-12 10:53:58,417 INFO [StoreOpener-b1a402c89b036415b368ef29d979b840-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1a402c89b036415b368ef29d979b840 columnFamilyName cf 2023-07-12 10:53:58,418 INFO [StoreOpener-ff97a258bc92c801021043e37c2141a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ff97a258bc92c801021043e37c2141a4 2023-07-12 10:53:58,419 INFO [StoreOpener-b1a402c89b036415b368ef29d979b840-1] regionserver.HStore(310): Store=b1a402c89b036415b368ef29d979b840/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:58,420 DEBUG [StoreOpener-ff97a258bc92c801021043e37c2141a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/cf 2023-07-12 10:53:58,420 DEBUG [StoreOpener-ff97a258bc92c801021043e37c2141a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/cf 2023-07-12 10:53:58,421 INFO [StoreOpener-ff97a258bc92c801021043e37c2141a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff97a258bc92c801021043e37c2141a4 columnFamilyName cf 2023-07-12 10:53:58,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840 2023-07-12 10:53:58,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840 2023-07-12 10:53:58,422 INFO [StoreOpener-ff97a258bc92c801021043e37c2141a4-1] regionserver.HStore(310): Store=ff97a258bc92c801021043e37c2141a4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:53:58,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4 2023-07-12 10:53:58,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4 2023-07-12 10:53:58,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for b1a402c89b036415b368ef29d979b840 2023-07-12 10:53:58,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:58,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ff97a258bc92c801021043e37c2141a4 2023-07-12 10:53:58,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened b1a402c89b036415b368ef29d979b840; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72795676, jitterRate=0.08474010229110718}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:58,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for b1a402c89b036415b368ef29d979b840: 2023-07-12 10:53:58,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840., pid=30, masterSystemTime=1689159238404 2023-07-12 10:53:58,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:53:58,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ff97a258bc92c801021043e37c2141a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68976729, jitterRate=0.027833357453346252}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:53:58,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ff97a258bc92c801021043e37c2141a4: 2023-07-12 10:53:58,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:53:58,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:53:58,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4., pid=31, masterSystemTime=1689159238407 2023-07-12 10:53:58,435 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b1a402c89b036415b368ef29d979b840, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:58,435 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159238435"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159238435"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159238435"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159238435"}]},"ts":"1689159238435"} 2023-07-12 10:53:58,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:53:58,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:53:58,436 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ff97a258bc92c801021043e37c2141a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:58,440 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159238436"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159238436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159238436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159238436"}]},"ts":"1689159238436"} 2023-07-12 10:53:58,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-12 10:53:58,447 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-12 10:53:58,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure b1a402c89b036415b368ef29d979b840, server=jenkins-hbase9.apache.org,34083,1689159209755 in 190 msec 2023-07-12 10:53:58,447 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure ff97a258bc92c801021043e37c2141a4, server=jenkins-hbase9.apache.org,46191,1689159209855 in 189 msec 2023-07-12 10:53:58,450 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b1a402c89b036415b368ef29d979b840, ASSIGN in 355 msec 2023-07-12 10:53:58,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-12 10:53:58,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ff97a258bc92c801021043e37c2141a4, ASSIGN in 355 msec 2023-07-12 10:53:58,453 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:53:58,453 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159238453"}]},"ts":"1689159238453"} 2023-07-12 10:53:58,455 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 10:53:58,458 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:53:58,459 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-12 10:53:58,461 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 10:53:58,462 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:58,462 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:58,462 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:58,462 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:53:58,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:58,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:58,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:58,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:53:58,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 897 msec 2023-07-12 10:53:58,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 10:53:58,686 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-12 10:53:58,691 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 10:53:58,691 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:53:58,693 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:53:58,729 DEBUG [hconnection-0x46f19b93-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:58,738 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:58,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:53:58,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159238748 (current time:1689159238748). 2023-07-12 10:53:58,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:53:58,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x14f4d020 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:58,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cb25e21, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:58,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:58,789 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:58,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14f4d020 to 127.0.0.1:53362 2023-07-12 10:53:58,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:58,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x6788794d to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:58,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@554fc04c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:58,822 DEBUG [hconnection-0x5b02df92-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:58,826 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:58,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:58,832 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:58,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6788794d to 127.0.0.1:53362 2023-07-12 10:53:58,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:58,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 10:53:58,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:53:58,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:53:58,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:53:58,842 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:53:58,843 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689159838843 2023-07-12 10:53:58,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:53:58,843 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 10:53:58,844 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:53:58,844 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:53:58,847 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:53:58,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 10:53:58,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-12 10:53:58,853 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 10:53:58,855 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689159838855 2023-07-12 10:53:58,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,877 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-12 10:53:58,877 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:58,879 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 10:53:58,879 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 10:53:58,939 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,939 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,940 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:58,940 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:58,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:58,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:58,940 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:58,940 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:58,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:58,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:58,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:58,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:58,941 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:58,941 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:58,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,942 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:58,942 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:53:58,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 10:53:58,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 10:53:58,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,943 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 10:53:58,943 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 10:53:58,943 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 10:53:58,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,943 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 10:53:58,943 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:58,943 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 10:53:58,943 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,945 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 10:53:58,945 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 10:53:58,945 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:58,945 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:58,945 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 10:53:58,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,947 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 10:53:58,947 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 10:53:58,947 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:53:58,947 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 10:53:58,948 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 10:53:58,948 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 10:53:58,948 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 10:53:58,948 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 10:53:58,948 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 10:53:58,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:53:58,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:58,949 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:53:58,950 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,955 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:58,955 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:58,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:58,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:58,956 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,956 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:58,956 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,956 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:58,956 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:58,956 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,956 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:53:58,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:58,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:58,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:58,958 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:58,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:58,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:58,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 10:53:58,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aeca876[Count = 1] remaining members to acquire global barrier 2023-07-12 10:53:58,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:58,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:58,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:58,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:58,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:58,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:58,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:58,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:58,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:58,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 10:53:58,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aeca876[Count = 0] remaining members to acquire global barrier 2023-07-12 10:53:58,965 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 10:53:58,965 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,967 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,967 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,967 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,967 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:53:58,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,967 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:53:58,967 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:58,967 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:58,967 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:58,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,968 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:53:58,968 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:53:58,968 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. started... 2023-07-12 10:53:58,968 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. started... 2023-07-12 10:53:58,968 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:53:58,968 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 10:53:58,968 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:58,969 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1a402c89b036415b368ef29d979b840: 2023-07-12 10:53:58,967 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:53:58,969 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ff97a258bc92c801021043e37c2141a4: 2023-07-12 10:53:58,969 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:53:58,968 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,36981,1689159209821' in zk 2023-07-12 10:53:58,970 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,970 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:58,970 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:53:58,970 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:58,970 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:53:58,970 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:53:58,970 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:53:58,972 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 10:53:58,972 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:58,972 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 10:53:58,994 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. completed. 2023-07-12 10:53:58,994 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:53:58,994 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:58,994 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:58,994 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:58,994 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 10:53:58,995 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,46191,1689159209855' in zk 2023-07-12 10:53:58,997 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 10:53:58,997 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:58,997 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:58,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:58,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:58,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:58,997 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 10:53:58,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:58,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:59,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:59,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:59,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:59,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:59,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:59,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:59,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,46191,1689159209855': 2023-07-12 10:53:59,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 10:53:59,149 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:59,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:53:59,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:59,151 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:53:59,395 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. completed. 2023-07-12 10:53:59,395 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:53:59,395 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:53:59,395 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:53:59,395 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:59,395 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 10:53:59,395 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,34083,1689159209755' in zk 2023-07-12 10:53:59,397 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 10:53:59,397 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:59,397 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:59,397 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 10:53:59,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:59,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:59,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:59,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:59,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:59,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:59,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:59,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:59,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:59,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:59,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:59,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:59,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,34083,1689159209755': 2023-07-12 10:53:59,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 10:53:59,403 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-12 10:53:59,403 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:53:59,403 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:53:59,403 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,403 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:53:59,404 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,404 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,405 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:53:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:53:59,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,405 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:59,405 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:59,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:59,405 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,405 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:59,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:53:59,405 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:59,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,406 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:53:59,406 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:59,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:53:59,409 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,409 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:59,409 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:59,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:59,414 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:59,414 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:59,414 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:59,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:59,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:59,414 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,414 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:59,414 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:53:59,414 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,414 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:59,414 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:59,414 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:53:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:59,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:53:59,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:53:59,416 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:53:59,416 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:59,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:59,416 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 10:53:59,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:59,416 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,416 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:53:59,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 10:53:59,416 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,416 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:53:59,416 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:53:59,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:59,417 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:59,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:53:59,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:53:59,417 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 10:53:59,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,452 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:59,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:53:59,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:53:59,453 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 10:53:59,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,507 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 10:53:59,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,508 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 10:53:59,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689159238844Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689159239442 (+598 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689159239442Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689159239442Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689159239450 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689159239472 (+22 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689159239507 (+35 ms) 2023-07-12 10:53:59,511 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 10:53:59,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 665 msec 2023-07-12 10:53:59,953 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:53:59,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:53:59,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:53:59,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34083] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:53:59,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46191] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:53:59,966 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 10:53:59,967 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:53:59,967 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:53:59,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:53:59,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159239978 (current time:1689159239978). 2023-07-12 10:53:59,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:53:59,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x5c2625e2 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:59,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6be5ee73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:53:59,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:53:59,989 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:53:59,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c2625e2 to 127.0.0.1:53362 2023-07-12 10:53:59,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:53:59,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x77cab38d to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:53:59,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e7c62f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:00,000 DEBUG [hconnection-0x7fe63d9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:00,001 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:00,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:00,008 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:00,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77cab38d to 127.0.0.1:53362 2023-07-12 10:54:00,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:00,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 10:54:00,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:54:00,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:54:00,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:54:00,015 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:54:00,016 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689159840016 2023-07-12 10:54:00,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:54:00,016 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 10:54:00,018 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:54:00,018 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:54:00,020 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:54:00,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 10:54:00,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-12 10:54:00,024 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 10:54:00,024 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689159840024 2023-07-12 10:54:00,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-12 10:54:00,036 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-12 10:54:00,036 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:00,037 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 10:54:00,037 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 10:54:00,038 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,038 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,039 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:00,040 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:00,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:00,040 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:00,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:00,040 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,041 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,041 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 10:54:00,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,041 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,042 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:54:00,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 10:54:00,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,042 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 10:54:00,042 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 10:54:00,042 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 10:54:00,042 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 10:54:00,042 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 10:54:00,042 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 10:54:00,042 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:00,042 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:00,044 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 10:54:00,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:00,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:00,045 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 10:54:00,045 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 10:54:00,045 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 10:54:00,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,045 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 10:54:00,045 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 10:54:00,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 10:54:00,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,046 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 10:54:00,047 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 10:54:00,047 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 10:54:00,047 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:00,047 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,047 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:00,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:00,048 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:00,048 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,048 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:00,049 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,049 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:00,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:00,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:54:00,050 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 10:54:00,050 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 10:54:00,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,050 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 10:54:00,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:00,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:00,057 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,057 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 10:54:00,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773c6244[Count = 1] remaining members to acquire global barrier 2023-07-12 10:54:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:00,057 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,057 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:00,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:00,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:00,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:54:00,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:00,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:00,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 10:54:00,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773c6244[Count = 0] remaining members to acquire global barrier 2023-07-12 10:54:00,060 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 10:54:00,060 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,061 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,061 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,061 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,061 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:54:00,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,062 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,062 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:54:00,062 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:00,062 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:00,062 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:54:00,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,062 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. started... 2023-07-12 10:54:00,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,062 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 10:54:00,062 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:54:00,062 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,062 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:54:00,062 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,36981,1689159209821' in zk 2023-07-12 10:54:00,062 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ff97a258bc92c801021043e37c2141a4 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-12 10:54:00,062 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:00,062 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:00,062 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:54:00,063 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. started... 2023-07-12 10:54:00,063 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b1a402c89b036415b368ef29d979b840 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-12 10:54:00,064 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 10:54:00,064 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:00,064 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 10:54:00,089 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307122c8fed9dfb5242a68c2c98be5c634ec6 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307122c8fed9dfb5242a68c2c98be5c634ec6 2023-07-12 10:54:00,094 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071205c8a56e3c83463e89d89baa62d9b1df to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071205c8a56e3c83463e89d89baa62d9b1df 2023-07-12 10:54:00,105 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/.tmp/cf/bc46633efee94a6494ae55b0c90c6de0 2023-07-12 10:54:00,110 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/.tmp/cf/dc8910767bdd4793831a3bd4e75e4349 2023-07-12 10:54:00,113 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/.tmp/cf/bc46633efee94a6494ae55b0c90c6de0 as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/cf/bc46633efee94a6494ae55b0c90c6de0 2023-07-12 10:54:00,116 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/.tmp/cf/dc8910767bdd4793831a3bd4e75e4349 as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/cf/dc8910767bdd4793831a3bd4e75e4349 2023-07-12 10:54:00,118 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:00,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:54:00,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:00,120 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:54:00,121 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/cf/bc46633efee94a6494ae55b0c90c6de0, entries=43, sequenceid=6, filesize=12.2 K 2023-07-12 10:54:00,122 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/cf/dc8910767bdd4793831a3bd4e75e4349, entries=7, sequenceid=6, filesize=6.1 K 2023-07-12 10:54:00,122 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for ff97a258bc92c801021043e37c2141a4 in 60ms, sequenceid=6, compaction requested=false 2023-07-12 10:54:00,123 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 10:54:00,123 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ff97a258bc92c801021043e37c2141a4: 2023-07-12 10:54:00,123 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for b1a402c89b036415b368ef29d979b840 in 60ms, sequenceid=6, compaction requested=false 2023-07-12 10:54:00,125 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1a402c89b036415b368ef29d979b840: 2023-07-12 10:54:00,125 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 10:54:00,125 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:00,125 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 10:54:00,125 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/cf/bc46633efee94a6494ae55b0c90c6de0] hfiles 2023-07-12 10:54:00,125 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:00,125 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/cf/bc46633efee94a6494ae55b0c90c6de0 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 10:54:00,125 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/cf/dc8910767bdd4793831a3bd4e75e4349] hfiles 2023-07-12 10:54:00,125 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/cf/dc8910767bdd4793831a3bd4e75e4349 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 10:54:00,149 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. completed. 2023-07-12 10:54:00,149 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:54:00,149 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:00,149 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:00,149 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,149 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 10:54:00,149 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,34083,1689159209755' in zk 2023-07-12 10:54:00,152 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. completed. 2023-07-12 10:54:00,152 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:54:00,152 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:00,152 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:00,152 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,152 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 10:54:00,152 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,46191,1689159209855' in zk 2023-07-12 10:54:00,156 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 10:54:00,156 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,156 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:00,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,156 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 10:54:00,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:00,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:00,159 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 10:54:00,159 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:00,159 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:00,159 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 10:54:00,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:54:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:00,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:00,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:54:00,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:00,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,34083,1689159209755': 2023-07-12 10:54:00,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 10:54:00,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:00,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:00,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:00,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:00,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:54:00,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:00,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:00,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:54:00,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:00,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,46191,1689159209855': 2023-07-12 10:54:00,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 10:54:00,170 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-12 10:54:00,170 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:54:00,170 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:54:00,170 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-12 10:54:00,170 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:54:00,172 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,172 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,172 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:00,172 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:00,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,172 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:00,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:00,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:00,173 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:54:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,173 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:00,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:00,174 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:54:00,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,174 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,175 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:00,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:00,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:00,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:00,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:00,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 10:54:00,176 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,177 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:00,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:00,177 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,181 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:00,181 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:00,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:00,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:00,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:00,181 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:00,181 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:00,181 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:00,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:00,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:00,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-12 10:54:00,181 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:00,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 10:54:00,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:00,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 10:54:00,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:00,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 10:54:00,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:00,181 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:00,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:00,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:00,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:00,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:00,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307122c8fed9dfb5242a68c2c98be5c634ec6, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071205c8a56e3c83463e89d89baa62d9b1df] mob files 2023-07-12 10:54:00,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307122c8fed9dfb5242a68c2c98be5c634ec6 2023-07-12 10:54:00,185 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071205c8a56e3c83463e89d89baa62d9b1df 2023-07-12 10:54:00,185 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,185 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,186 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:00,186 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,186 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,186 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:00,186 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,186 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:00,186 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:00,186 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,186 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-12 10:54:00,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,237 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 10:54:00,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,238 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689159240016Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689159240193 (+177 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689159240193Loading Region manifests for snaptb0-testExportFileSystemState at 1689159240193Writing data manifest for snaptb0-testExportFileSystemState at 1689159240198 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689159240207 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689159240237 (+30 ms) 2023-07-12 10:54:00,240 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 10:54:00,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 224 msec 2023-07-12 10:54:00,320 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:00,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:54:00,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:54:00,321 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159240321 2023-07-12 10:54:00,322 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44111, tgtDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159240321, rawTgtDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159240321, srcFsUri=hdfs://localhost:44111, srcDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:54:00,350 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:54:00,351 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_861798067_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159240321, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159240321/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,351 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648, snapshotDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-12 10:54:00,365 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159240321/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 10:54:00,391 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:00,392 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:00,392 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:00,392 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:00,393 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:00,393 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:00,394 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:00,464 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/hadoop-4935857758081963383.jar 2023-07-12 10:54:00,465 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:00,465 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:00,466 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:00,466 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:00,466 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:00,466 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:00,467 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:54:00,467 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:54:00,468 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:54:00,468 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:54:00,468 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:54:00,469 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:54:00,469 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:54:00,469 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:54:00,470 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:54:00,470 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:54:00,471 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:00,471 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:00,471 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:00,472 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:00,472 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:00,472 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:00,473 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:00,918 WARN [Listener at jenkins-hbase9.apache.org/45227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:54:00,921 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-12 10:54:00,923 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 10:54:01,928 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:01,928 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:01,934 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0001_000001 (auth:SIMPLE) 2023-07-12 10:54:01,980 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0002_000001 (auth:SIMPLE) 2023-07-12 10:54:02,791 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:54:06,664 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0002_000001 (auth:SIMPLE) 2023-07-12 10:54:08,887 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0002_000001 (auth:SIMPLE) 2023-07-12 10:54:12,981 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0002_000001 (auth:SIMPLE) 2023-07-12 10:54:14,126 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:54:14,127 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:54:14,141 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-12 10:54:14,141 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:54:14,142 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:54:14,142 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_272028698_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 10:54:14,143 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 10:54:14,143 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 10:54:14,143 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_272028698_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159240321/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159240321/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 10:54:14,144 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159240321/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 10:54:14,144 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159240321/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 10:54:14,156 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-12 10:54:14,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-07-12 10:54:14,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 10:54:14,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159254164"}]},"ts":"1689159254164"} 2023-07-12 10:54:14,166 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 10:54:14,167 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-12 10:54:14,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b1a402c89b036415b368ef29d979b840, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ff97a258bc92c801021043e37c2141a4, UNASSIGN}] 2023-07-12 10:54:14,170 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ff97a258bc92c801021043e37c2141a4, UNASSIGN 2023-07-12 10:54:14,170 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b1a402c89b036415b368ef29d979b840, UNASSIGN 2023-07-12 10:54:14,171 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ff97a258bc92c801021043e37c2141a4, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:14,171 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b1a402c89b036415b368ef29d979b840, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:14,171 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159254171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159254171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159254171"}]},"ts":"1689159254171"} 2023-07-12 10:54:14,171 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159254171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159254171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159254171"}]},"ts":"1689159254171"} 2023-07-12 10:54:14,173 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure ff97a258bc92c801021043e37c2141a4, server=jenkins-hbase9.apache.org,46191,1689159209855}] 2023-07-12 10:54:14,174 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure b1a402c89b036415b368ef29d979b840, server=jenkins-hbase9.apache.org,34083,1689159209755}] 2023-07-12 10:54:14,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 10:54:14,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close b1a402c89b036415b368ef29d979b840 2023-07-12 10:54:14,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing b1a402c89b036415b368ef29d979b840, disabling compactions & flushes 2023-07-12 10:54:14,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ff97a258bc92c801021043e37c2141a4 2023-07-12 10:54:14,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:54:14,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ff97a258bc92c801021043e37c2141a4, disabling compactions & flushes 2023-07-12 10:54:14,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:54:14,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:54:14,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. after waiting 0 ms 2023-07-12 10:54:14,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:54:14,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:54:14,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. after waiting 0 ms 2023-07-12 10:54:14,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:54:14,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:54:14,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:54:14,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:54:14,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:54:14,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840. 2023-07-12 10:54:14,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4. 2023-07-12 10:54:14,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for b1a402c89b036415b368ef29d979b840: 2023-07-12 10:54:14,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ff97a258bc92c801021043e37c2141a4: 2023-07-12 10:54:14,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ff97a258bc92c801021043e37c2141a4 2023-07-12 10:54:14,348 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ff97a258bc92c801021043e37c2141a4, regionState=CLOSED 2023-07-12 10:54:14,348 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159254348"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159254348"}]},"ts":"1689159254348"} 2023-07-12 10:54:14,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed b1a402c89b036415b368ef29d979b840 2023-07-12 10:54:14,349 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b1a402c89b036415b368ef29d979b840, regionState=CLOSED 2023-07-12 10:54:14,349 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689159254349"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159254349"}]},"ts":"1689159254349"} 2023-07-12 10:54:14,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-12 10:54:14,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure ff97a258bc92c801021043e37c2141a4, server=jenkins-hbase9.apache.org,46191,1689159209855 in 177 msec 2023-07-12 10:54:14,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-12 10:54:14,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure b1a402c89b036415b368ef29d979b840, server=jenkins-hbase9.apache.org,34083,1689159209755 in 177 msec 2023-07-12 10:54:14,354 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ff97a258bc92c801021043e37c2141a4, UNASSIGN in 184 msec 2023-07-12 10:54:14,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-12 10:54:14,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b1a402c89b036415b368ef29d979b840, UNASSIGN in 185 msec 2023-07-12 10:54:14,357 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159254356"}]},"ts":"1689159254356"} 2023-07-12 10:54:14,358 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 10:54:14,361 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-12 10:54:14,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 206 msec 2023-07-12 10:54:14,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 10:54:14,466 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-12 10:54:14,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-07-12 10:54:14,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,472 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-12 10:54:14,473 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,474 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-12 10:54:14,476 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,476 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,476 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,476 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 10:54:14,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 10:54:14,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 10:54:14,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 10:54:14,478 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,478 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,478 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:14,478 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:14,478 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,478 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 10:54:14,478 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:14,478 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:14,478 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840 2023-07-12 10:54:14,479 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4 2023-07-12 10:54:14,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 10:54:14,480 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/recovered.edits] 2023-07-12 10:54:14,480 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/recovered.edits] 2023-07-12 10:54:14,484 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/cf/dc8910767bdd4793831a3bd4e75e4349 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/cf/dc8910767bdd4793831a3bd4e75e4349 2023-07-12 10:54:14,484 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/cf/bc46633efee94a6494ae55b0c90c6de0 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/cf/bc46633efee94a6494ae55b0c90c6de0 2023-07-12 10:54:14,487 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/recovered.edits/9.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840/recovered.edits/9.seqid 2023-07-12 10:54:14,488 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/recovered.edits/9.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4/recovered.edits/9.seqid 2023-07-12 10:54:14,488 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/b1a402c89b036415b368ef29d979b840 2023-07-12 10:54:14,488 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemState/ff97a258bc92c801021043e37c2141a4 2023-07-12 10:54:14,488 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 10:54:14,489 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 10:54:14,490 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-12 10:54:14,493 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307122c8fed9dfb5242a68c2c98be5c634ec6 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307122c8fed9dfb5242a68c2c98be5c634ec6 2023-07-12 10:54:14,495 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071205c8a56e3c83463e89d89baa62d9b1df to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071205c8a56e3c83463e89d89baa62d9b1df 2023-07-12 10:54:14,495 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 10:54:14,498 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,500 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-12 10:54:14,502 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-12 10:54:14,503 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,503 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-12 10:54:14,503 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159254503"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:14,503 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159254503"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:14,505 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 10:54:14,505 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b1a402c89b036415b368ef29d979b840, NAME => 'testtb-testExportFileSystemState,,1689159237565.b1a402c89b036415b368ef29d979b840.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ff97a258bc92c801021043e37c2141a4, NAME => 'testtb-testExportFileSystemState,1,1689159237565.ff97a258bc92c801021043e37c2141a4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 10:54:14,505 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-12 10:54:14,505 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159254505"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:14,507 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-12 10:54:14,510 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 10:54:14,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 42 msec 2023-07-12 10:54:14,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 10:54:14,581 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-12 10:54:14,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-12 10:54:14,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-12 10:54:14,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-07-12 10:54:14,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-12 10:54:14,624 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 751) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-11800691_1 at /127.0.0.1:50694 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2024 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:50716 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-11800691_1 at /127.0.0.1:39480 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase9.apache.org/172.31.2.10:45307 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:41126 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:39504 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase9.apache.org/172.31.2.10:43965 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=940 (was 919) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=466 (was 532), ProcessCount=178 (was 178), AvailableMemoryMB=6156 (was 6428) 2023-07-12 10:54:14,624 WARN [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 10:54:14,653 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=940, MaxFileDescriptor=60000, SystemLoadAverage=466, ProcessCount=178, AvailableMemoryMB=6155 2023-07-12 10:54:14,654 WARN [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 10:54:14,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 10:54:14,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:14,660 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:54:14,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-12 10:54:14,661 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:54:14,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 10:54:14,668 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b 2023-07-12 10:54:14,669 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143 2023-07-12 10:54:14,669 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b empty. 2023-07-12 10:54:14,670 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143 empty. 2023-07-12 10:54:14,670 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b 2023-07-12 10:54:14,671 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143 2023-07-12 10:54:14,671 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 10:54:14,695 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-12 10:54:14,697 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => f45753c99592823111c1843ed63abc3b, NAME => 'testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:54:14,697 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 615e5a005a8532726e3d9f055b2dc143, NAME => 'testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:54:14,718 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:14,718 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 615e5a005a8532726e3d9f055b2dc143, disabling compactions & flushes 2023-07-12 10:54:14,718 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:14,718 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:14,718 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. after waiting 0 ms 2023-07-12 10:54:14,718 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:14,718 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:14,718 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 615e5a005a8532726e3d9f055b2dc143: 2023-07-12 10:54:14,721 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:14,721 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing f45753c99592823111c1843ed63abc3b, disabling compactions & flushes 2023-07-12 10:54:14,721 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:14,721 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:14,721 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. after waiting 0 ms 2023-07-12 10:54:14,721 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:14,721 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:14,721 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for f45753c99592823111c1843ed63abc3b: 2023-07-12 10:54:14,724 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:54:14,725 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159254725"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159254725"}]},"ts":"1689159254725"} 2023-07-12 10:54:14,725 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159254725"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159254725"}]},"ts":"1689159254725"} 2023-07-12 10:54:14,727 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:54:14,728 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:54:14,728 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159254728"}]},"ts":"1689159254728"} 2023-07-12 10:54:14,730 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-12 10:54:14,732 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:54:14,733 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:54:14,734 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:54:14,734 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:54:14,734 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:54:14,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f45753c99592823111c1843ed63abc3b, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=615e5a005a8532726e3d9f055b2dc143, ASSIGN}] 2023-07-12 10:54:14,736 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=615e5a005a8532726e3d9f055b2dc143, ASSIGN 2023-07-12 10:54:14,737 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f45753c99592823111c1843ed63abc3b, ASSIGN 2023-07-12 10:54:14,738 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f45753c99592823111c1843ed63abc3b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34083,1689159209755; forceNewPlan=false, retain=false 2023-07-12 10:54:14,738 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=615e5a005a8532726e3d9f055b2dc143, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46191,1689159209855; forceNewPlan=false, retain=false 2023-07-12 10:54:14,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 10:54:14,888 INFO [jenkins-hbase9:39303] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:54:14,891 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f45753c99592823111c1843ed63abc3b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:14,891 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=615e5a005a8532726e3d9f055b2dc143, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:14,891 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159254890"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159254890"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159254890"}]},"ts":"1689159254890"} 2023-07-12 10:54:14,891 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159254890"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159254890"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159254890"}]},"ts":"1689159254890"} 2023-07-12 10:54:14,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure f45753c99592823111c1843ed63abc3b, server=jenkins-hbase9.apache.org,34083,1689159209755}] 2023-07-12 10:54:14,894 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 615e5a005a8532726e3d9f055b2dc143, server=jenkins-hbase9.apache.org,46191,1689159209855}] 2023-07-12 10:54:14,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 10:54:15,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:15,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:15,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 615e5a005a8532726e3d9f055b2dc143, NAME => 'testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 10:54:15,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f45753c99592823111c1843ed63abc3b, NAME => 'testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 10:54:15,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. service=AccessControlService 2023-07-12 10:54:15,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. service=AccessControlService 2023-07-12 10:54:15,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:15,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:15,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports f45753c99592823111c1843ed63abc3b 2023-07-12 10:54:15,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 615e5a005a8532726e3d9f055b2dc143 2023-07-12 10:54:15,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:15,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:15,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f45753c99592823111c1843ed63abc3b 2023-07-12 10:54:15,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 615e5a005a8532726e3d9f055b2dc143 2023-07-12 10:54:15,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f45753c99592823111c1843ed63abc3b 2023-07-12 10:54:15,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 615e5a005a8532726e3d9f055b2dc143 2023-07-12 10:54:15,051 INFO [StoreOpener-f45753c99592823111c1843ed63abc3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f45753c99592823111c1843ed63abc3b 2023-07-12 10:54:15,051 INFO [StoreOpener-615e5a005a8532726e3d9f055b2dc143-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 615e5a005a8532726e3d9f055b2dc143 2023-07-12 10:54:15,052 DEBUG [StoreOpener-f45753c99592823111c1843ed63abc3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/cf 2023-07-12 10:54:15,053 DEBUG [StoreOpener-f45753c99592823111c1843ed63abc3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/cf 2023-07-12 10:54:15,053 DEBUG [StoreOpener-615e5a005a8532726e3d9f055b2dc143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/cf 2023-07-12 10:54:15,053 DEBUG [StoreOpener-615e5a005a8532726e3d9f055b2dc143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/cf 2023-07-12 10:54:15,053 INFO [StoreOpener-f45753c99592823111c1843ed63abc3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f45753c99592823111c1843ed63abc3b columnFamilyName cf 2023-07-12 10:54:15,053 INFO [StoreOpener-615e5a005a8532726e3d9f055b2dc143-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 615e5a005a8532726e3d9f055b2dc143 columnFamilyName cf 2023-07-12 10:54:15,054 INFO [StoreOpener-f45753c99592823111c1843ed63abc3b-1] regionserver.HStore(310): Store=f45753c99592823111c1843ed63abc3b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:15,054 INFO [StoreOpener-615e5a005a8532726e3d9f055b2dc143-1] regionserver.HStore(310): Store=615e5a005a8532726e3d9f055b2dc143/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:15,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b 2023-07-12 10:54:15,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143 2023-07-12 10:54:15,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b 2023-07-12 10:54:15,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143 2023-07-12 10:54:15,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f45753c99592823111c1843ed63abc3b 2023-07-12 10:54:15,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 615e5a005a8532726e3d9f055b2dc143 2023-07-12 10:54:15,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:54:15,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:54:15,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f45753c99592823111c1843ed63abc3b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61096542, jitterRate=-0.08959057927131653}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:15,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f45753c99592823111c1843ed63abc3b: 2023-07-12 10:54:15,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b., pid=45, masterSystemTime=1689159255045 2023-07-12 10:54:15,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 615e5a005a8532726e3d9f055b2dc143; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67167445, jitterRate=8.729249238967896E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:15,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:15,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 615e5a005a8532726e3d9f055b2dc143: 2023-07-12 10:54:15,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:15,064 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f45753c99592823111c1843ed63abc3b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143., pid=46, masterSystemTime=1689159255045 2023-07-12 10:54:15,064 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159255064"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159255064"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159255064"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159255064"}]},"ts":"1689159255064"} 2023-07-12 10:54:15,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:15,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:15,067 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=615e5a005a8532726e3d9f055b2dc143, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,067 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159255067"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159255067"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159255067"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159255067"}]},"ts":"1689159255067"} 2023-07-12 10:54:15,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-12 10:54:15,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure f45753c99592823111c1843ed63abc3b, server=jenkins-hbase9.apache.org,34083,1689159209755 in 173 msec 2023-07-12 10:54:15,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f45753c99592823111c1843ed63abc3b, ASSIGN in 334 msec 2023-07-12 10:54:15,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-12 10:54:15,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 615e5a005a8532726e3d9f055b2dc143, server=jenkins-hbase9.apache.org,46191,1689159209855 in 174 msec 2023-07-12 10:54:15,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-12 10:54:15,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=615e5a005a8532726e3d9f055b2dc143, ASSIGN in 336 msec 2023-07-12 10:54:15,073 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:54:15,073 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159255073"}]},"ts":"1689159255073"} 2023-07-12 10:54:15,074 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-12 10:54:15,076 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:54:15,077 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-12 10:54:15,078 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 10:54:15,080 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:15,080 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:15,080 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:15,080 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:15,082 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:15,082 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:15,082 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:15,082 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:15,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 426 msec 2023-07-12 10:54:15,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 10:54:15,266 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-12 10:54:15,270 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 10:54:15,270 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:15,272 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:54:15,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 10:54:15,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159255287 (current time:1689159255287). 2023-07-12 10:54:15,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:54:15,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x3249c3a1 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:15,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7083de2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:15,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:15,302 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:15,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3249c3a1 to 127.0.0.1:53362 2023-07-12 10:54:15,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:15,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x5807cf31 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:15,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@242f5b5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:15,319 DEBUG [hconnection-0x4a339b45-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:15,322 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:15,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:15,330 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:15,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5807cf31 to 127.0.0.1:53362 2023-07-12 10:54:15,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:15,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 10:54:15,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:54:15,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 10:54:15,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 10:54:15,337 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 10:54:15,338 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689159855338 2023-07-12 10:54:15,338 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 10:54:15,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 10:54:15,338 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:54:15,338 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:54:15,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 10:54:15,350 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 10:54:15,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 16 msec 2023-07-12 10:54:15,353 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 10:54:15,354 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689159855354 2023-07-12 10:54:15,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,376 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-12 10:54:15,376 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:15,378 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 10:54:15,378 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 10:54:15,379 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,379 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,380 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,380 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,380 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,380 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,380 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,381 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,381 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,381 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:54:15,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 10:54:15,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 10:54:15,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,382 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 10:54:15,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 10:54:15,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,382 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 10:54:15,382 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 10:54:15,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,382 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 10:54:15,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,382 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 10:54:15,383 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 10:54:15,383 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:15,382 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:15,383 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:15,385 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 10:54:15,389 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 10:54:15,389 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 10:54:15,385 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 10:54:15,389 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 10:54:15,389 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 10:54:15,389 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 10:54:15,389 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 10:54:15,389 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 10:54:15,391 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,391 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,391 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,391 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:15,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:15,393 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:15,393 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,393 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:15,393 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,393 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:15,393 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,393 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:15,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:15,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:15,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:15,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 10:54:15,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2adbad38[Count = 1] remaining members to acquire global barrier 2023-07-12 10:54:15,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:15,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:15,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:15,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:15,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:15,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:15,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 10:54:15,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2adbad38[Count = 0] remaining members to acquire global barrier 2023-07-12 10:54:15,398 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 10:54:15,398 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,399 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,399 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,399 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,399 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 10:54:15,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,399 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,399 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 10:54:15,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,399 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,36981,1689159209821' in zk 2023-07-12 10:54:15,399 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 10:54:15,399 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 10:54:15,400 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:15,400 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:15,400 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,400 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:54:15,400 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:15,400 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. started... 2023-07-12 10:54:15,400 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:15,400 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:15,400 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f45753c99592823111c1843ed63abc3b: 2023-07-12 10:54:15,400 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:15,400 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. started... 2023-07-12 10:54:15,400 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,400 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:15,400 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:54:15,402 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 615e5a005a8532726e3d9f055b2dc143: 2023-07-12 10:54:15,402 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,403 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:15,403 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:54:15,404 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 10:54:15,404 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:15,404 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 10:54:15,431 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. completed. 2023-07-12 10:54:15,431 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:15,431 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:15,431 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:15,431 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,431 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 10:54:15,431 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,34083,1689159209755' in zk 2023-07-12 10:54:15,434 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:15,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:15,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:15,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:15,436 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 10:54:15,436 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:15,436 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 10:54:15,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:15,439 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:15,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:15,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 10:54:15,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:15,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:15,441 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:54:15,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,34083,1689159209755': 2023-07-12 10:54:15,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 10:54:15,641 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:15,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 10:54:15,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:15,642 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:54:15,836 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. completed. 2023-07-12 10:54:15,837 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:15,837 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:15,837 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:15,837 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,837 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 10:54:15,837 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,46191,1689159209855' in zk 2023-07-12 10:54:15,838 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,838 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 10:54:15,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:15,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:15,839 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:15,839 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 10:54:15,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:15,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:15,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:15,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,46191,1689159209855': 2023-07-12 10:54:15,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 10:54:15,844 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-12 10:54:15,844 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:54:15,844 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:54:15,844 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,844 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:54:15,845 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,845 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,845 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:15,845 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:15,845 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,845 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:15,846 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:15,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,846 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:15,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:15,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:15,847 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,847 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,849 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:15,849 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,850 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,852 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,852 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,852 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,852 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:15,853 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,853 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:15,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,853 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:15,853 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,853 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:15,853 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,853 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:15,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,853 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:15,853 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:15,853 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:15,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 10:54:15,853 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:15,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 10:54:15,855 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:15,855 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:15,855 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,855 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:15,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:15,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:15,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 10:54:15,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,942 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:15,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 10:54:15,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:15,944 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 10:54:15,948 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 10:54:15,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,948 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:15,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689159255338Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689159255870 (+532 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689159255870Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689159255870Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689159255875 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689159255890 (+15 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689159255948 (+58 ms) 2023-07-12 10:54:15,952 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 10:54:15,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 612 msec 2023-07-12 10:54:16,444 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:16,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 10:54:16,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:54:16,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34083] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:54:16,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46191] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:54:16,456 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 10:54:16,456 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:16,456 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:54:16,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 10:54:16,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159256476 (current time:1689159256476). 2023-07-12 10:54:16,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:54:16,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x4a9335df to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:16,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28fdc6f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:16,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:16,494 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:16,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a9335df to 127.0.0.1:53362 2023-07-12 10:54:16,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:16,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x04605ae3 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:16,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@570eaa7d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:16,503 DEBUG [hconnection-0x11022c2a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:16,506 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:16,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:16,511 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:16,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04605ae3 to 127.0.0.1:53362 2023-07-12 10:54:16,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:16,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 10:54:16,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:54:16,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 10:54:16,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 10:54:16,517 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 10:54:16,518 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689159856518 2023-07-12 10:54:16,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 10:54:16,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 10:54:16,520 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:54:16,520 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:54:16,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 10:54:16,522 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 10:54:16,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-12 10:54:16,525 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 10:54:16,526 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689159856526 2023-07-12 10:54:16,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-12 10:54:16,569 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-12 10:54:16,569 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:16,571 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 10:54:16,571 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 10:54:16,571 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,572 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,574 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:16,574 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:16,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:16,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:16,574 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,574 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:16,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:16,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:16,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:16,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:16,574 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,574 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,575 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,575 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:54:16,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 10:54:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 10:54:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 10:54:16,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 10:54:16,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 10:54:16,576 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 10:54:16,576 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,578 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 10:54:16,578 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 10:54:16,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 10:54:16,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,578 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 10:54:16,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 10:54:16,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 10:54:16,578 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 10:54:16,578 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:16,580 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 10:54:16,580 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 10:54:16,580 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 10:54:16,580 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 10:54:16,580 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 10:54:16,580 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:16,581 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 10:54:16,581 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 10:54:16,581 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 10:54:16,582 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,582 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:16,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:16,583 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,583 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,584 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,584 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,585 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,585 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:16,585 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:16,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:16,585 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,585 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:16,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:16,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:16,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:16,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 10:54:16,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e694e37[Count = 1] remaining members to acquire global barrier 2023-07-12 10:54:16,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:16,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:16,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:16,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:16,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:16,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:16,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 10:54:16,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e694e37[Count = 0] remaining members to acquire global barrier 2023-07-12 10:54:16,588 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 10:54:16,589 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,591 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,591 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,591 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,591 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 10:54:16,591 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 10:54:16,591 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 10:54:16,591 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,592 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,36981,1689159209821' in zk 2023-07-12 10:54:16,592 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 10:54:16,592 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:16,592 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:16,592 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:16,592 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. started... 2023-07-12 10:54:16,592 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:16,592 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:16,592 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:16,592 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,592 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:54:16,592 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. started... 2023-07-12 10:54:16,592 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 615e5a005a8532726e3d9f055b2dc143 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-12 10:54:16,592 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f45753c99592823111c1843ed63abc3b 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-12 10:54:16,594 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 10:54:16,594 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:16,594 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 10:54:16,620 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:16,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 10:54:16,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:16,622 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:54:16,623 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307129acf1fbaf8784d9ba5cecb78ebf8c611 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307129acf1fbaf8784d9ba5cecb78ebf8c611 2023-07-12 10:54:16,626 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712c7e48be45fa54e8c81efa0ca157d9fcc to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712c7e48be45fa54e8c81efa0ca157d9fcc 2023-07-12 10:54:16,638 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/.tmp/cf/8a8351a489bd4508996da428c4ad0d5e 2023-07-12 10:54:16,644 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/.tmp/cf/8a8351a489bd4508996da428c4ad0d5e as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/cf/8a8351a489bd4508996da428c4ad0d5e 2023-07-12 10:54:16,646 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/.tmp/cf/981a8c08572940238afc0bcb5297719e 2023-07-12 10:54:16,650 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/cf/8a8351a489bd4508996da428c4ad0d5e, entries=6, sequenceid=6, filesize=5.9 K 2023-07-12 10:54:16,651 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for f45753c99592823111c1843ed63abc3b in 58ms, sequenceid=6, compaction requested=false 2023-07-12 10:54:16,651 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 10:54:16,651 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/.tmp/cf/981a8c08572940238afc0bcb5297719e as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/cf/981a8c08572940238afc0bcb5297719e 2023-07-12 10:54:16,651 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f45753c99592823111c1843ed63abc3b: 2023-07-12 10:54:16,652 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 10:54:16,652 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:16,652 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/cf/8a8351a489bd4508996da428c4ad0d5e] hfiles 2023-07-12 10:54:16,652 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/cf/8a8351a489bd4508996da428c4ad0d5e for snapshot=snaptb0-testConsecutiveExports 2023-07-12 10:54:16,657 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/cf/981a8c08572940238afc0bcb5297719e, entries=44, sequenceid=6, filesize=12.2 K 2023-07-12 10:54:16,658 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 615e5a005a8532726e3d9f055b2dc143 in 66ms, sequenceid=6, compaction requested=false 2023-07-12 10:54:16,659 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 615e5a005a8532726e3d9f055b2dc143: 2023-07-12 10:54:16,660 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 10:54:16,660 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:16,660 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/cf/981a8c08572940238afc0bcb5297719e] hfiles 2023-07-12 10:54:16,660 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/cf/981a8c08572940238afc0bcb5297719e for snapshot=snaptb0-testConsecutiveExports 2023-07-12 10:54:16,661 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. completed. 2023-07-12 10:54:16,661 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:16,661 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:16,661 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:16,661 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,661 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 10:54:16,661 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,34083,1689159209755' in zk 2023-07-12 10:54:16,663 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,663 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 10:54:16,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:16,663 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:16,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:16,663 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 10:54:16,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:16,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:16,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:16,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:16,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,668 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. completed. 2023-07-12 10:54:16,668 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:16,669 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:16,669 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:16,669 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:16,669 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 10:54:16,669 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,46191,1689159209855' in zk 2023-07-12 10:54:16,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,34083,1689159209755': 2023-07-12 10:54:16,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 10:54:16,671 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,671 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 10:54:16,671 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:16,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:16,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:16,671 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 10:54:16,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:16,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:16,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:16,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:16,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:16,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,46191,1689159209855': 2023-07-12 10:54:16,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 10:54:16,676 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-12 10:54:16,676 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:54:16,676 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:54:16,676 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-12 10:54:16,676 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:54:16,678 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,678 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,678 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,678 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,678 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:16,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:16,678 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:16,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:16,678 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:16,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,679 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,679 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:16,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,680 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:16,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:16,682 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 10:54:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,682 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:16,682 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,690 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:16,690 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,690 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:16,690 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:16,690 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:16,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:16,691 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:16,690 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,690 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:16,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:16,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:16,692 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:16,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:16,692 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:16,691 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-12 10:54:16,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:16,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:16,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:16,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 10:54:16,692 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:16,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 10:54:16,693 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,693 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:16,693 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,693 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:16,693 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:16,693 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,693 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 10:54:16,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:16,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:16,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:16,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:16,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712c7e48be45fa54e8c81efa0ca157d9fcc, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307129acf1fbaf8784d9ba5cecb78ebf8c611] mob files 2023-07-12 10:54:16,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712c7e48be45fa54e8c81efa0ca157d9fcc 2023-07-12 10:54:16,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307129acf1fbaf8784d9ba5cecb78ebf8c611 2023-07-12 10:54:16,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-12 10:54:16,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,756 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 10:54:16,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,756 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689159256519Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689159256713 (+194 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689159256713Loading Region manifests for snaptb0-testConsecutiveExports at 1689159256713Writing data manifest for snaptb0-testConsecutiveExports at 1689159256716 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689159256730 (+14 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689159256756 (+26 ms) 2023-07-12 10:54:16,759 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 10:54:16,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 239 msec 2023-07-12 10:54:16,822 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:16,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 10:54:16,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:54:16,823 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823 2023-07-12 10:54:16,824 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823, srcFsUri=hdfs://localhost:44111, srcDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:54:16,845 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:54:16,845 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6448eb79, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,845 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648, snapshotDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 10:54:16,854 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:16,866 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,866 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,867 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,867 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,867 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,868 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,868 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,937 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/hadoop-7211677895053425384.jar 2023-07-12 10:54:16,937 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,938 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,938 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,938 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,939 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,939 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:16,939 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:54:16,940 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:54:16,940 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:54:16,940 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:54:16,941 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:54:16,941 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:54:16,942 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:54:16,942 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:54:16,942 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:54:16,943 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:54:16,943 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:16,943 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:16,944 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:16,944 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:16,944 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:16,945 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:16,945 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:17,783 WARN [Listener at jenkins-hbase9.apache.org/45227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:54:17,786 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 10:54:17,788 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 10:54:19,165 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:19,165 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:19,169 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0002_000001 (auth:SIMPLE) 2023-07-12 10:54:19,948 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:54:19,978 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0003_000001 (auth:SIMPLE) 2023-07-12 10:54:24,468 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0003_000001 (auth:SIMPLE) 2023-07-12 10:54:26,718 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0003_000001 (auth:SIMPLE) 2023-07-12 10:54:30,970 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:54:30,971 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:54:30,975 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 10:54:30,976 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:54:30,976 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:54:30,976 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_272028698_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 10:54:30,977 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 10:54:30,977 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 10:54:30,978 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6166b20b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 10:54:30,978 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 10:54:30,978 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 10:54:30,980 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823, srcFsUri=hdfs://localhost:44111, srcDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:54:31,006 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:54:31,006 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@e54ac61, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:31,006 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648, snapshotDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 10:54:31,021 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 10:54:31,037 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:31,037 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:31,038 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:31,038 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:31,038 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:31,039 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:31,039 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:31,113 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/hadoop-937512310088327790.jar 2023-07-12 10:54:31,114 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:31,114 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:31,115 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:31,115 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:31,116 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:31,116 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:31,117 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:54:31,117 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:54:31,117 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:54:31,118 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:54:31,118 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:54:31,119 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:54:31,119 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:54:31,119 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:54:31,120 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:54:31,120 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:54:31,120 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:31,121 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:31,121 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:31,121 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:31,122 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:31,122 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:31,122 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:31,882 WARN [Listener at jenkins-hbase9.apache.org/45227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:54:31,884 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 10:54:31,886 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 10:54:36,010 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:36,011 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:36,013 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0003_000001 (auth:SIMPLE) 2023-07-12 10:54:36,181 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0004_000001 (auth:SIMPLE) 2023-07-12 10:54:40,628 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0004_000001 (auth:SIMPLE) 2023-07-12 10:54:42,858 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0004_000001 (auth:SIMPLE) 2023-07-12 10:54:46,464 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0004_000001 (auth:SIMPLE) 2023-07-12 10:54:48,275 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:54:48,276 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:54:48,290 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 10:54:48,290 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:54:48,291 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:54:48,291 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_272028698_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 10:54:48,302 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 10:54:48,302 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 10:54:48,302 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6166b20b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 10:54:48,302 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 10:54:48,303 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/local-export-1689159256823/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 10:54:48,320 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-12 10:54:48,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-07-12 10:54:48,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:48,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 10:54:48,330 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159288329"}]},"ts":"1689159288329"} 2023-07-12 10:54:48,332 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-12 10:54:48,334 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-12 10:54:48,335 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f45753c99592823111c1843ed63abc3b, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=615e5a005a8532726e3d9f055b2dc143, UNASSIGN}] 2023-07-12 10:54:48,336 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=615e5a005a8532726e3d9f055b2dc143, UNASSIGN 2023-07-12 10:54:48,338 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f45753c99592823111c1843ed63abc3b, UNASSIGN 2023-07-12 10:54:48,339 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=615e5a005a8532726e3d9f055b2dc143, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:48,339 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159288339"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159288339"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159288339"}]},"ts":"1689159288339"} 2023-07-12 10:54:48,340 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=f45753c99592823111c1843ed63abc3b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:48,340 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159288340"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159288340"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159288340"}]},"ts":"1689159288340"} 2023-07-12 10:54:48,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 615e5a005a8532726e3d9f055b2dc143, server=jenkins-hbase9.apache.org,46191,1689159209855}] 2023-07-12 10:54:48,344 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure f45753c99592823111c1843ed63abc3b, server=jenkins-hbase9.apache.org,34083,1689159209755}] 2023-07-12 10:54:48,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 10:54:48,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 615e5a005a8532726e3d9f055b2dc143 2023-07-12 10:54:48,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 615e5a005a8532726e3d9f055b2dc143, disabling compactions & flushes 2023-07-12 10:54:48,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:48,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:48,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. after waiting 0 ms 2023-07-12 10:54:48,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:48,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f45753c99592823111c1843ed63abc3b 2023-07-12 10:54:48,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f45753c99592823111c1843ed63abc3b, disabling compactions & flushes 2023-07-12 10:54:48,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:48,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:48,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. after waiting 0 ms 2023-07-12 10:54:48,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:48,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:54:48,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:54:48,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143. 2023-07-12 10:54:48,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 615e5a005a8532726e3d9f055b2dc143: 2023-07-12 10:54:48,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:54:48,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:54:48,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b. 2023-07-12 10:54:48,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f45753c99592823111c1843ed63abc3b: 2023-07-12 10:54:48,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 615e5a005a8532726e3d9f055b2dc143 2023-07-12 10:54:48,553 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=615e5a005a8532726e3d9f055b2dc143, regionState=CLOSED 2023-07-12 10:54:48,553 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159288553"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159288553"}]},"ts":"1689159288553"} 2023-07-12 10:54:48,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f45753c99592823111c1843ed63abc3b 2023-07-12 10:54:48,554 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=f45753c99592823111c1843ed63abc3b, regionState=CLOSED 2023-07-12 10:54:48,554 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689159288554"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159288554"}]},"ts":"1689159288554"} 2023-07-12 10:54:48,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-12 10:54:48,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 615e5a005a8532726e3d9f055b2dc143, server=jenkins-hbase9.apache.org,46191,1689159209855 in 213 msec 2023-07-12 10:54:48,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-12 10:54:48,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure f45753c99592823111c1843ed63abc3b, server=jenkins-hbase9.apache.org,34083,1689159209755 in 215 msec 2023-07-12 10:54:48,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=615e5a005a8532726e3d9f055b2dc143, UNASSIGN in 229 msec 2023-07-12 10:54:48,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-12 10:54:48,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f45753c99592823111c1843ed63abc3b, UNASSIGN in 232 msec 2023-07-12 10:54:48,580 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159288580"}]},"ts":"1689159288580"} 2023-07-12 10:54:48,582 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-12 10:54:48,584 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-12 10:54:48,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 264 msec 2023-07-12 10:54:48,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 10:54:48,631 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-12 10:54:48,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-07-12 10:54:48,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:48,637 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:48,638 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:48,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-12 10:54:48,651 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-12 10:54:48,653 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b 2023-07-12 10:54:48,655 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/recovered.edits] 2023-07-12 10:54:48,659 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:48,659 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:48,659 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:48,660 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:48,660 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 10:54:48,660 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 10:54:48,661 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 10:54:48,661 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:48,661 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:48,661 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:48,661 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:48,661 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-12 10:54:48,662 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 10:54:48,662 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:48,662 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 10:54:48,662 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:48,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 10:54:48,671 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143 2023-07-12 10:54:48,677 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/cf/8a8351a489bd4508996da428c4ad0d5e to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/cf/8a8351a489bd4508996da428c4ad0d5e 2023-07-12 10:54:48,683 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/recovered.edits/9.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b/recovered.edits/9.seqid 2023-07-12 10:54:48,684 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/f45753c99592823111c1843ed63abc3b 2023-07-12 10:54:48,684 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/recovered.edits] 2023-07-12 10:54:48,698 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/cf/981a8c08572940238afc0bcb5297719e to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/cf/981a8c08572940238afc0bcb5297719e 2023-07-12 10:54:48,706 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/recovered.edits/9.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143/recovered.edits/9.seqid 2023-07-12 10:54:48,707 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testConsecutiveExports/615e5a005a8532726e3d9f055b2dc143 2023-07-12 10:54:48,707 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 10:54:48,708 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 10:54:48,709 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-12 10:54:48,716 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712c7e48be45fa54e8c81efa0ca157d9fcc to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712c7e48be45fa54e8c81efa0ca157d9fcc 2023-07-12 10:54:48,719 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307129acf1fbaf8784d9ba5cecb78ebf8c611 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307129acf1fbaf8784d9ba5cecb78ebf8c611 2023-07-12 10:54:48,719 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 10:54:48,724 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:48,727 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-12 10:54:48,730 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-12 10:54:48,734 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:48,734 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-12 10:54:48,734 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159288734"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:48,735 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159288734"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:48,737 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 10:54:48,737 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f45753c99592823111c1843ed63abc3b, NAME => 'testtb-testConsecutiveExports,,1689159254655.f45753c99592823111c1843ed63abc3b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 615e5a005a8532726e3d9f055b2dc143, NAME => 'testtb-testConsecutiveExports,1,1689159254655.615e5a005a8532726e3d9f055b2dc143.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 10:54:48,738 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-12 10:54:48,738 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159288738"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:48,741 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-12 10:54:48,745 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 10:54:48,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 112 msec 2023-07-12 10:54:48,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 10:54:48,764 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-12 10:54:48,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-12 10:54:48,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-12 10:54:48,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-07-12 10:54:48,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-12 10:54:48,819 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 763), OpenFileDescriptor=911 (was 940), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=409 (was 466), ProcessCount=180 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=6424 (was 6155) - AvailableMemoryMB LEAK? - 2023-07-12 10:54:48,820 WARN [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-12 10:54:48,843 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=180, AvailableMemoryMB=6414 2023-07-12 10:54:48,843 WARN [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-12 10:54:48,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 10:54:48,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:48,850 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:54:48,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-12 10:54:48,851 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:54:48,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 10:54:48,856 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e 2023-07-12 10:54:48,856 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a 2023-07-12 10:54:48,857 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e empty. 2023-07-12 10:54:48,857 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e 2023-07-12 10:54:48,857 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a empty. 2023-07-12 10:54:48,858 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a 2023-07-12 10:54:48,858 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 10:54:48,896 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-12 10:54:48,898 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6ca6e71e5c1817d42dd2306396a42e4e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:54:48,898 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 08fc2877dc2e9e601772da02f2861e3a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:54:48,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:48,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 08fc2877dc2e9e601772da02f2861e3a, disabling compactions & flushes 2023-07-12 10:54:48,921 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:54:48,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:54:48,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:48,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. after waiting 0 ms 2023-07-12 10:54:48,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 6ca6e71e5c1817d42dd2306396a42e4e, disabling compactions & flushes 2023-07-12 10:54:48,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:54:48,921 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:54:48,921 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:54:48,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:54:48,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 08fc2877dc2e9e601772da02f2861e3a: 2023-07-12 10:54:48,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. after waiting 0 ms 2023-07-12 10:54:48,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:54:48,922 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:54:48,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 6ca6e71e5c1817d42dd2306396a42e4e: 2023-07-12 10:54:48,924 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:54:48,926 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159288925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159288925"}]},"ts":"1689159288925"} 2023-07-12 10:54:48,926 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159288925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159288925"}]},"ts":"1689159288925"} 2023-07-12 10:54:48,932 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:54:48,933 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:54:48,934 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159288933"}]},"ts":"1689159288933"} 2023-07-12 10:54:48,941 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-12 10:54:48,947 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:54:48,949 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:54:48,949 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:54:48,949 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:54:48,949 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:54:48,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ca6e71e5c1817d42dd2306396a42e4e, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fc2877dc2e9e601772da02f2861e3a, ASSIGN}] 2023-07-12 10:54:48,952 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fc2877dc2e9e601772da02f2861e3a, ASSIGN 2023-07-12 10:54:48,952 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ca6e71e5c1817d42dd2306396a42e4e, ASSIGN 2023-07-12 10:54:48,953 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fc2877dc2e9e601772da02f2861e3a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46191,1689159209855; forceNewPlan=false, retain=false 2023-07-12 10:54:48,953 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ca6e71e5c1817d42dd2306396a42e4e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34083,1689159209755; forceNewPlan=false, retain=false 2023-07-12 10:54:48,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 10:54:49,104 INFO [jenkins-hbase9:39303] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:54:49,107 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=08fc2877dc2e9e601772da02f2861e3a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,107 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=6ca6e71e5c1817d42dd2306396a42e4e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,107 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159289107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159289107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159289107"}]},"ts":"1689159289107"} 2023-07-12 10:54:49,107 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159289107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159289107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159289107"}]},"ts":"1689159289107"} 2023-07-12 10:54:49,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 08fc2877dc2e9e601772da02f2861e3a, server=jenkins-hbase9.apache.org,46191,1689159209855}] 2023-07-12 10:54:49,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 6ca6e71e5c1817d42dd2306396a42e4e, server=jenkins-hbase9.apache.org,34083,1689159209755}] 2023-07-12 10:54:49,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 10:54:49,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:54:49,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:54:49,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 08fc2877dc2e9e601772da02f2861e3a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 10:54:49,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ca6e71e5c1817d42dd2306396a42e4e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 10:54:49,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. service=AccessControlService 2023-07-12 10:54:49,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. service=AccessControlService 2023-07-12 10:54:49,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:49,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:49,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 08fc2877dc2e9e601772da02f2861e3a 2023-07-12 10:54:49,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 6ca6e71e5c1817d42dd2306396a42e4e 2023-07-12 10:54:49,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:49,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:49,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 08fc2877dc2e9e601772da02f2861e3a 2023-07-12 10:54:49,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 08fc2877dc2e9e601772da02f2861e3a 2023-07-12 10:54:49,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 6ca6e71e5c1817d42dd2306396a42e4e 2023-07-12 10:54:49,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 6ca6e71e5c1817d42dd2306396a42e4e 2023-07-12 10:54:49,279 INFO [StoreOpener-08fc2877dc2e9e601772da02f2861e3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 08fc2877dc2e9e601772da02f2861e3a 2023-07-12 10:54:49,279 INFO [StoreOpener-6ca6e71e5c1817d42dd2306396a42e4e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6ca6e71e5c1817d42dd2306396a42e4e 2023-07-12 10:54:49,281 DEBUG [StoreOpener-08fc2877dc2e9e601772da02f2861e3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/cf 2023-07-12 10:54:49,281 DEBUG [StoreOpener-08fc2877dc2e9e601772da02f2861e3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/cf 2023-07-12 10:54:49,281 DEBUG [StoreOpener-6ca6e71e5c1817d42dd2306396a42e4e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/cf 2023-07-12 10:54:49,282 DEBUG [StoreOpener-6ca6e71e5c1817d42dd2306396a42e4e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/cf 2023-07-12 10:54:49,282 INFO [StoreOpener-08fc2877dc2e9e601772da02f2861e3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08fc2877dc2e9e601772da02f2861e3a columnFamilyName cf 2023-07-12 10:54:49,283 INFO [StoreOpener-6ca6e71e5c1817d42dd2306396a42e4e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ca6e71e5c1817d42dd2306396a42e4e columnFamilyName cf 2023-07-12 10:54:49,284 INFO [StoreOpener-6ca6e71e5c1817d42dd2306396a42e4e-1] regionserver.HStore(310): Store=6ca6e71e5c1817d42dd2306396a42e4e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:49,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e 2023-07-12 10:54:49,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e 2023-07-12 10:54:49,286 INFO [StoreOpener-08fc2877dc2e9e601772da02f2861e3a-1] regionserver.HStore(310): Store=08fc2877dc2e9e601772da02f2861e3a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:49,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a 2023-07-12 10:54:49,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a 2023-07-12 10:54:49,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 6ca6e71e5c1817d42dd2306396a42e4e 2023-07-12 10:54:49,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 08fc2877dc2e9e601772da02f2861e3a 2023-07-12 10:54:49,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:54:49,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:54:49,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 6ca6e71e5c1817d42dd2306396a42e4e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65101695, jitterRate=-0.029909148812294006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:49,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 6ca6e71e5c1817d42dd2306396a42e4e: 2023-07-12 10:54:49,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 08fc2877dc2e9e601772da02f2861e3a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63496570, jitterRate=-0.053827375173568726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:49,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 08fc2877dc2e9e601772da02f2861e3a: 2023-07-12 10:54:49,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a., pid=60, masterSystemTime=1689159289266 2023-07-12 10:54:49,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e., pid=61, masterSystemTime=1689159289267 2023-07-12 10:54:49,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:54:49,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:54:49,305 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=08fc2877dc2e9e601772da02f2861e3a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,306 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159289305"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159289305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159289305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159289305"}]},"ts":"1689159289305"} 2023-07-12 10:54:49,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:54:49,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:54:49,308 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=6ca6e71e5c1817d42dd2306396a42e4e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,308 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159289308"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159289308"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159289308"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159289308"}]},"ts":"1689159289308"} 2023-07-12 10:54:49,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-12 10:54:49,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 6ca6e71e5c1817d42dd2306396a42e4e, server=jenkins-hbase9.apache.org,34083,1689159209755 in 198 msec 2023-07-12 10:54:49,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-12 10:54:49,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 08fc2877dc2e9e601772da02f2861e3a, server=jenkins-hbase9.apache.org,46191,1689159209855 in 197 msec 2023-07-12 10:54:49,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ca6e71e5c1817d42dd2306396a42e4e, ASSIGN in 367 msec 2023-07-12 10:54:49,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-12 10:54:49,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fc2877dc2e9e601772da02f2861e3a, ASSIGN in 368 msec 2023-07-12 10:54:49,321 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:54:49,321 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159289321"}]},"ts":"1689159289321"} 2023-07-12 10:54:49,326 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-12 10:54:49,330 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:54:49,330 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-12 10:54:49,332 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 10:54:49,334 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:49,334 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:49,334 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:49,334 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:49,339 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,340 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,340 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,340 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,340 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:49,340 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:49,341 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:49,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:49,344 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 497 msec 2023-07-12 10:54:49,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 10:54:49,458 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-12 10:54:49,461 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,461 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:54:49,462 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:54:49,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 10:54:49,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159289493 (current time:1689159289493). 2023-07-12 10:54:49,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:54:49,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x4be34ad7 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:49,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24c54f96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:49,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:49,510 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:49,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4be34ad7 to 127.0.0.1:53362 2023-07-12 10:54:49,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:49,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x0345cf00 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:49,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5221884d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:49,533 DEBUG [hconnection-0x5c16d460-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:49,534 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:49,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:49,542 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:49,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0345cf00 to 127.0.0.1:53362 2023-07-12 10:54:49,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:49,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 10:54:49,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:54:49,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 10:54:49,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 10:54:49,549 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 10:54:49,550 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689159889550 2023-07-12 10:54:49,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 10:54:49,550 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,553 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 10:54:49,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 10:54:49,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-12 10:54:49,555 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 10:54:49,556 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689159889556 2023-07-12 10:54:49,558 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:54:49,558 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:54:49,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,592 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 10:54:49,592 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:49,594 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 10:54:49,594 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 10:54:49,648 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,648 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,649 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:49,649 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:49,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:49,649 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,649 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:49,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:49,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:49,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,650 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,650 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,651 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,651 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:54:49,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 10:54:49,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 10:54:49,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,652 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 10:54:49,652 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 10:54:49,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 10:54:49,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,652 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 10:54:49,652 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 10:54:49,652 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:49,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,652 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 10:54:49,654 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 10:54:49,654 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 10:54:49,653 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,654 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 10:54:49,654 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:49,654 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 10:54:49,656 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:49,656 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 10:54:49,657 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 10:54:49,657 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 10:54:49,657 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 10:54:49,657 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 10:54:49,657 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 10:54:49,658 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:49,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:49,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:49,660 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:49,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:49,660 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,661 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:54:49,661 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,661 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,661 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:49,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:49,662 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,662 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:49,662 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,662 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,663 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,663 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:49,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 10:54:49,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5109fa94[Count = 1] remaining members to acquire global barrier 2023-07-12 10:54:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:49,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:49,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 10:54:49,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5109fa94[Count = 0] remaining members to acquire global barrier 2023-07-12 10:54:49,667 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 10:54:49,667 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,668 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,668 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,668 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,668 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 10:54:49,668 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,668 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:54:49,668 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 10:54:49,668 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. started... 2023-07-12 10:54:49,669 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,669 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:49,669 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:49,668 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:49,669 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:54:49,670 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08fc2877dc2e9e601772da02f2861e3a: 2023-07-12 10:54:49,669 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:54:49,668 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 10:54:49,670 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. started... 2023-07-12 10:54:49,670 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,670 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:49,671 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ca6e71e5c1817d42dd2306396a42e4e: 2023-07-12 10:54:49,670 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:49,670 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 10:54:49,671 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,671 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,36981,1689159209821' in zk 2023-07-12 10:54:49,671 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:54:49,671 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:49,671 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:54:49,676 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 10:54:49,676 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:49,676 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 10:54:49,716 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. completed. 2023-07-12 10:54:49,716 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:54:49,716 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:49,716 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:49,716 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,716 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 10:54:49,717 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,46191,1689159209855' in zk 2023-07-12 10:54:49,718 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. completed. 2023-07-12 10:54:49,718 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:54:49,718 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:49,718 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:49,718 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,718 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 10:54:49,718 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,34083,1689159209755' in zk 2023-07-12 10:54:49,719 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,719 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 10:54:49,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,719 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:49,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:49,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:49,719 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 10:54:49,722 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,722 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 10:54:49,722 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:49,722 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 10:54:49,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:49,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:49,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:49,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:49,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:49,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,46191,1689159209855': 2023-07-12 10:54:49,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 10:54:49,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:49,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:49,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:49,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:49,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:49,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:49,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:49,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,34083,1689159209755': 2023-07-12 10:54:49,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 10:54:49,739 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 10:54:49,739 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:54:49,739 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:54:49,739 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,739 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:54:49,741 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,741 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,741 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:49,741 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,741 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,741 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:49,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,741 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:49,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:49,742 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:49,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,742 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:49,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,744 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:49,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,746 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:49,747 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:49,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,747 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:49,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,753 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:49,753 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:49,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:49,753 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:49,753 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:49,753 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:49,755 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:49,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:49,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:49,754 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:49,753 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,753 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:49,753 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,756 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:49,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:49,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:49,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:49,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:49,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:49,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 10:54:49,756 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:49,756 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,756 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,756 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:49,757 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,757 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:49,757 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:49,757 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,757 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:49,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 10:54:49,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,861 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:49,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:49,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:49,862 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:54:49,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 10:54:49,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,884 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:49,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689159289550Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689159289784 (+234 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689159289784Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689159289784Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689159289789 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689159289843 (+54 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689159289883 (+40 ms) 2023-07-12 10:54:49,887 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 10:54:49,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 336 msec 2023-07-12 10:54:50,162 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:50,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:50,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:54:50,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34083] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:54:50,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46191] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:54:50,188 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,189 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:54:50,189 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:54:50,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 10:54:50,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159290206 (current time:1689159290206). 2023-07-12 10:54:50,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:54:50,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x4311a0c1 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:50,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b10f7f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:50,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:50,242 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:50,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4311a0c1 to 127.0.0.1:53362 2023-07-12 10:54:50,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:50,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x3654d083 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:50,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@788d6920, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:50,285 DEBUG [hconnection-0x74cb4bb9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:50,289 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:50,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:50,313 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:50,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3654d083 to 127.0.0.1:53362 2023-07-12 10:54:50,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:50,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 10:54:50,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:54:50,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 10:54:50,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 10:54:50,321 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 10:54:50,322 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689159890322 2023-07-12 10:54:50,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 10:54:50,323 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,324 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:54:50,325 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:54:50,326 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 10:54:50,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 10:54:50,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-12 10:54:50,331 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 10:54:50,332 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689159890332 2023-07-12 10:54:50,365 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,366 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 10:54:50,366 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:50,367 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 10:54:50,368 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 10:54:50,368 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,368 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,369 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:50,369 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:50,370 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:50,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:50,369 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:50,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:50,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:50,370 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,370 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,371 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,371 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:54:50,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 10:54:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,371 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 10:54:50,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 10:54:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,372 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 10:54:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 10:54:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,373 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 10:54:50,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,374 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 10:54:50,374 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:50,376 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 10:54:50,376 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 10:54:50,376 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 10:54:50,377 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,377 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:50,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:50,378 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,378 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,378 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 10:54:50,378 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:50,378 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:50,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:50,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:50,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:50,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 10:54:50,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45338cb3[Count = 1] remaining members to acquire global barrier 2023-07-12 10:54:50,393 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,394 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 10:54:50,395 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 10:54:50,396 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 10:54:50,396 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:50,396 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 10:54:50,397 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 10:54:50,397 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 10:54:50,397 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 10:54:50,399 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,400 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,400 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:50,407 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,407 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:50,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:50,408 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,408 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:50,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:50,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:50,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:50,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:50,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 10:54:50,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45338cb3[Count = 0] remaining members to acquire global barrier 2023-07-12 10:54:50,410 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 10:54:50,410 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,412 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,412 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,412 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 10:54:50,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,412 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,412 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 10:54:50,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,412 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 10:54:50,412 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 10:54:50,412 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,36981,1689159209821' in zk 2023-07-12 10:54:50,413 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,413 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,414 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:54:50,414 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 10:54:50,414 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:50,414 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 10:54:50,425 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:50,425 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:50,425 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:54:50,425 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. started... 2023-07-12 10:54:50,425 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 08fc2877dc2e9e601772da02f2861e3a 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-12 10:54:50,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:50,425 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:54:50,426 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. started... 2023-07-12 10:54:50,426 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6ca6e71e5c1817d42dd2306396a42e4e 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-12 10:54:50,425 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:50,427 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:50,425 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:50,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:50,427 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:54:50,495 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712b41829a4da3d44e7be2f977d7024a8ff to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712b41829a4da3d44e7be2f977d7024a8ff 2023-07-12 10:54:50,502 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712f9f70714e64041eb9aca2b5191f98ff6 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712f9f70714e64041eb9aca2b5191f98ff6 2023-07-12 10:54:50,522 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/.tmp/cf/81df256acd1d4d08bfed18ccd7cc77a7 2023-07-12 10:54:50,529 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/.tmp/cf/81df256acd1d4d08bfed18ccd7cc77a7 as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/cf/81df256acd1d4d08bfed18ccd7cc77a7 2023-07-12 10:54:50,535 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/cf/81df256acd1d4d08bfed18ccd7cc77a7, entries=49, sequenceid=6, filesize=13.9 K 2023-07-12 10:54:50,536 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 08fc2877dc2e9e601772da02f2861e3a in 111ms, sequenceid=6, compaction requested=false 2023-07-12 10:54:50,536 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-12 10:54:50,537 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08fc2877dc2e9e601772da02f2861e3a: 2023-07-12 10:54:50,537 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,537 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:50,537 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/cf/81df256acd1d4d08bfed18ccd7cc77a7] hfiles 2023-07-12 10:54:50,538 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/cf/81df256acd1d4d08bfed18ccd7cc77a7 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,546 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/.tmp/cf/20ddea755a3d4b4fa917e3bfb46cf990 2023-07-12 10:54:50,551 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/.tmp/cf/20ddea755a3d4b4fa917e3bfb46cf990 as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/cf/20ddea755a3d4b4fa917e3bfb46cf990 2023-07-12 10:54:50,558 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/cf/20ddea755a3d4b4fa917e3bfb46cf990, entries=1, sequenceid=6, filesize=5.1 K 2023-07-12 10:54:50,559 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 6ca6e71e5c1817d42dd2306396a42e4e in 133ms, sequenceid=6, compaction requested=false 2023-07-12 10:54:50,563 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ca6e71e5c1817d42dd2306396a42e4e: 2023-07-12 10:54:50,563 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,563 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:50,563 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/cf/20ddea755a3d4b4fa917e3bfb46cf990] hfiles 2023-07-12 10:54:50,563 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/cf/20ddea755a3d4b4fa917e3bfb46cf990 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,570 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. completed. 2023-07-12 10:54:50,570 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:54:50,570 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:50,570 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:50,570 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,570 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 10:54:50,570 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,46191,1689159209855' in zk 2023-07-12 10:54:50,572 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,572 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 10:54:50,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:50,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:50,572 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:50,572 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 10:54:50,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:50,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:50,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:50,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:50,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:50,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,46191,1689159209855': 2023-07-12 10:54:50,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 10:54:50,590 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. completed. 2023-07-12 10:54:50,590 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:54:50,590 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:50,590 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:50,590 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,590 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 10:54:50,590 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,34083,1689159209755' in zk 2023-07-12 10:54:50,593 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,593 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 10:54:50,593 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:50,593 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 10:54:50,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:50,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:50,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:50,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:50,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:50,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:50,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:50,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,34083,1689159209755': 2023-07-12 10:54:50,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 10:54:50,599 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 10:54:50,599 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:54:50,599 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:54:50,599 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,599 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:54:50,606 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,606 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,606 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:50,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,606 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:50,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,606 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,606 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:50,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,606 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:50,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:50,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:50,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:50,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,611 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,611 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:50,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:50,612 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,614 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,615 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:50,615 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,618 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:50,618 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:50,618 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:50,618 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:50,618 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:50,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:50,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:50,618 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:50,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:50,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:50,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:50,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:50,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:50,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:50,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:50,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:50,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:50,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:50,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:50,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:50,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:50,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:50,621 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:50,621 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,623 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 10:54:50,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712b41829a4da3d44e7be2f977d7024a8ff, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712f9f70714e64041eb9aca2b5191f98ff6] mob files 2023-07-12 10:54:50,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712b41829a4da3d44e7be2f977d7024a8ff 2023-07-12 10:54:50,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712f9f70714e64041eb9aca2b5191f98ff6 2023-07-12 10:54:50,628 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:50,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:50,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:50,635 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:54:50,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,676 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,746 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 10:54:50,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,746 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:54:50,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689159290323Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689159290671 (+348 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689159290671Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689159290671Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689159290683 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689159290706 (+23 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689159290746 (+40 ms) 2023-07-12 10:54:50,750 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 10:54:50,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 426 msec 2023-07-12 10:54:50,935 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:50,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 10:54:50,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:54:50,981 DEBUG [Listener at jenkins-hbase9.apache.org/45227] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 10:54:50,985 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 10:54:50,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34083] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 10:54:50,987 DEBUG [Listener at jenkins-hbase9.apache.org/45227] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 10:54:50,991 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 10:54:50,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36981] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 10:54:50,996 DEBUG [Listener at jenkins-hbase9.apache.org/45227] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 10:54:51,004 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 10:54:51,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46191] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 10:54:51,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 10:54:51,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:51,010 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:54:51,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-12 10:54:51,012 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:54:51,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 10:54:51,018 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:54:51,018 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:54:51,018 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2 empty. 2023-07-12 10:54:51,018 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a empty. 2023-07-12 10:54:51,019 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:54:51,019 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:54:51,019 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 10:54:51,037 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-12 10:54:51,039 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2ece6997ba836f0a85acf0b606aa7fc2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:54:51,039 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 400c676ba43d17d655c093ebf1fa879a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:54:51,050 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:51,050 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 2ece6997ba836f0a85acf0b606aa7fc2, disabling compactions & flushes 2023-07-12 10:54:51,050 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. 2023-07-12 10:54:51,051 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. 2023-07-12 10:54:51,051 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:51,051 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. after waiting 0 ms 2023-07-12 10:54:51,051 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 400c676ba43d17d655c093ebf1fa879a, disabling compactions & flushes 2023-07-12 10:54:51,051 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. 2023-07-12 10:54:51,051 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. 2023-07-12 10:54:51,051 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. 2023-07-12 10:54:51,051 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. 2023-07-12 10:54:51,051 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 2ece6997ba836f0a85acf0b606aa7fc2: 2023-07-12 10:54:51,051 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. after waiting 0 ms 2023-07-12 10:54:51,051 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. 2023-07-12 10:54:51,051 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. 2023-07-12 10:54:51,051 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 400c676ba43d17d655c093ebf1fa879a: 2023-07-12 10:54:51,053 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:54:51,054 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159291054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159291054"}]},"ts":"1689159291054"} 2023-07-12 10:54:51,054 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159291054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159291054"}]},"ts":"1689159291054"} 2023-07-12 10:54:51,057 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:54:51,058 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:54:51,058 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159291058"}]},"ts":"1689159291058"} 2023-07-12 10:54:51,059 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-12 10:54:51,063 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:54:51,064 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:54:51,064 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:54:51,064 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:54:51,064 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:54:51,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ece6997ba836f0a85acf0b606aa7fc2, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=400c676ba43d17d655c093ebf1fa879a, ASSIGN}] 2023-07-12 10:54:51,067 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=400c676ba43d17d655c093ebf1fa879a, ASSIGN 2023-07-12 10:54:51,067 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ece6997ba836f0a85acf0b606aa7fc2, ASSIGN 2023-07-12 10:54:51,068 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=400c676ba43d17d655c093ebf1fa879a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34083,1689159209755; forceNewPlan=false, retain=false 2023-07-12 10:54:51,068 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ece6997ba836f0a85acf0b606aa7fc2, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46191,1689159209855; forceNewPlan=false, retain=false 2023-07-12 10:54:51,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 10:54:51,218 INFO [jenkins-hbase9:39303] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:54:51,222 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2ece6997ba836f0a85acf0b606aa7fc2, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:51,222 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=400c676ba43d17d655c093ebf1fa879a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:51,222 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159291222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159291222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159291222"}]},"ts":"1689159291222"} 2023-07-12 10:54:51,222 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159291222"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159291222"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159291222"}]},"ts":"1689159291222"} 2023-07-12 10:54:51,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 2ece6997ba836f0a85acf0b606aa7fc2, server=jenkins-hbase9.apache.org,46191,1689159209855}] 2023-07-12 10:54:51,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 400c676ba43d17d655c093ebf1fa879a, server=jenkins-hbase9.apache.org,34083,1689159209755}] 2023-07-12 10:54:51,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 10:54:51,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. 2023-07-12 10:54:51,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2ece6997ba836f0a85acf0b606aa7fc2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2.', STARTKEY => '', ENDKEY => '2'} 2023-07-12 10:54:51,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. service=AccessControlService 2023-07-12 10:54:51,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:51,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:54:51,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:51,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:54:51,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:54:51,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. 2023-07-12 10:54:51,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 400c676ba43d17d655c093ebf1fa879a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 10:54:51,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. service=AccessControlService 2023-07-12 10:54:51,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:51,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:54:51,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:51,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:54:51,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:54:51,394 INFO [StoreOpener-2ece6997ba836f0a85acf0b606aa7fc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:54:51,402 INFO [StoreOpener-400c676ba43d17d655c093ebf1fa879a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:54:51,404 DEBUG [StoreOpener-400c676ba43d17d655c093ebf1fa879a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/cf 2023-07-12 10:54:51,404 DEBUG [StoreOpener-400c676ba43d17d655c093ebf1fa879a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/cf 2023-07-12 10:54:51,405 INFO [StoreOpener-400c676ba43d17d655c093ebf1fa879a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 400c676ba43d17d655c093ebf1fa879a columnFamilyName cf 2023-07-12 10:54:51,405 INFO [StoreOpener-400c676ba43d17d655c093ebf1fa879a-1] regionserver.HStore(310): Store=400c676ba43d17d655c093ebf1fa879a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:51,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:54:51,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:54:51,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:54:51,413 DEBUG [StoreOpener-2ece6997ba836f0a85acf0b606aa7fc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/cf 2023-07-12 10:54:51,413 DEBUG [StoreOpener-2ece6997ba836f0a85acf0b606aa7fc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/cf 2023-07-12 10:54:51,414 INFO [StoreOpener-2ece6997ba836f0a85acf0b606aa7fc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ece6997ba836f0a85acf0b606aa7fc2 columnFamilyName cf 2023-07-12 10:54:51,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:54:51,416 INFO [StoreOpener-2ece6997ba836f0a85acf0b606aa7fc2-1] regionserver.HStore(310): Store=2ece6997ba836f0a85acf0b606aa7fc2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:51,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 400c676ba43d17d655c093ebf1fa879a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70643018, jitterRate=0.05266299843788147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:51,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 400c676ba43d17d655c093ebf1fa879a: 2023-07-12 10:54:51,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:54:51,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a., pid=70, masterSystemTime=1689159291377 2023-07-12 10:54:51,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:54:51,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. 2023-07-12 10:54:51,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. 2023-07-12 10:54:51,420 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=400c676ba43d17d655c093ebf1fa879a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:51,420 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159291420"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159291420"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159291420"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159291420"}]},"ts":"1689159291420"} 2023-07-12 10:54:51,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-12 10:54:51,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 400c676ba43d17d655c093ebf1fa879a, server=jenkins-hbase9.apache.org,34083,1689159209755 in 197 msec 2023-07-12 10:54:51,425 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=400c676ba43d17d655c093ebf1fa879a, ASSIGN in 360 msec 2023-07-12 10:54:51,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:54:51,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:54:51,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2ece6997ba836f0a85acf0b606aa7fc2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71780576, jitterRate=0.06961393356323242}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:51,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2ece6997ba836f0a85acf0b606aa7fc2: 2023-07-12 10:54:51,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2., pid=69, masterSystemTime=1689159291376 2023-07-12 10:54:51,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. 2023-07-12 10:54:51,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. 2023-07-12 10:54:51,444 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2ece6997ba836f0a85acf0b606aa7fc2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:51,444 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159291444"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159291444"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159291444"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159291444"}]},"ts":"1689159291444"} 2023-07-12 10:54:51,453 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-12 10:54:51,453 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 2ece6997ba836f0a85acf0b606aa7fc2, server=jenkins-hbase9.apache.org,46191,1689159209855 in 221 msec 2023-07-12 10:54:51,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-12 10:54:51,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ece6997ba836f0a85acf0b606aa7fc2, ASSIGN in 389 msec 2023-07-12 10:54:51,461 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:54:51,462 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159291461"}]},"ts":"1689159291461"} 2023-07-12 10:54:51,463 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-12 10:54:51,466 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:54:51,466 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-12 10:54:51,471 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 10:54:51,472 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:51,472 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:51,472 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:51,472 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:54:51,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:51,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:51,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:51,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:51,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:51,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:51,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:51,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 468 msec 2023-07-12 10:54:51,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 10:54:51,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 10:54:51,618 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-12 10:54:51,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions 2ece6997ba836f0a85acf0b606aa7fc2, 400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:54:51,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2ece6997ba836f0a85acf0b606aa7fc2, 400c676ba43d17d655c093ebf1fa879a], force=true 2023-07-12 10:54:51,659 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2ece6997ba836f0a85acf0b606aa7fc2, 400c676ba43d17d655c093ebf1fa879a], force=true 2023-07-12 10:54:51,659 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2ece6997ba836f0a85acf0b606aa7fc2, 400c676ba43d17d655c093ebf1fa879a], force=true 2023-07-12 10:54:51,659 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2ece6997ba836f0a85acf0b606aa7fc2, 400c676ba43d17d655c093ebf1fa879a], force=true 2023-07-12 10:54:51,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 10:54:51,689 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ece6997ba836f0a85acf0b606aa7fc2, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=400c676ba43d17d655c093ebf1fa879a, UNASSIGN}] 2023-07-12 10:54:51,693 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=400c676ba43d17d655c093ebf1fa879a, UNASSIGN 2023-07-12 10:54:51,694 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ece6997ba836f0a85acf0b606aa7fc2, UNASSIGN 2023-07-12 10:54:51,694 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=400c676ba43d17d655c093ebf1fa879a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:51,694 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2ece6997ba836f0a85acf0b606aa7fc2, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:51,695 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159291694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159291694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159291694"}]},"ts":"1689159291694"} 2023-07-12 10:54:51,695 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159291694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159291694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159291694"}]},"ts":"1689159291694"} 2023-07-12 10:54:51,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 2ece6997ba836f0a85acf0b606aa7fc2, server=jenkins-hbase9.apache.org,46191,1689159209855}] 2023-07-12 10:54:51,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 400c676ba43d17d655c093ebf1fa879a, server=jenkins-hbase9.apache.org,34083,1689159209755}] 2023-07-12 10:54:51,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 10:54:51,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:54:51,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 2ece6997ba836f0a85acf0b606aa7fc2, disabling compactions & flushes 2023-07-12 10:54:51,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:54:51,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. 2023-07-12 10:54:51,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. 2023-07-12 10:54:51,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. after waiting 0 ms 2023-07-12 10:54:51,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 400c676ba43d17d655c093ebf1fa879a, disabling compactions & flushes 2023-07-12 10:54:51,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. 2023-07-12 10:54:51,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. 2023-07-12 10:54:51,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 2ece6997ba836f0a85acf0b606aa7fc2 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 10:54:51,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. 2023-07-12 10:54:51,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. after waiting 0 ms 2023-07-12 10:54:51,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. 2023-07-12 10:54:51,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 400c676ba43d17d655c093ebf1fa879a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 10:54:51,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/.tmp/cf/b3a10d4d5a2b4aeb93401fd570ac032b 2023-07-12 10:54:51,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/.tmp/cf/87eb40b9fc1e4071a90f85325ea8e18f 2023-07-12 10:54:51,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/.tmp/cf/b3a10d4d5a2b4aeb93401fd570ac032b as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/cf/b3a10d4d5a2b4aeb93401fd570ac032b 2023-07-12 10:54:51,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/.tmp/cf/87eb40b9fc1e4071a90f85325ea8e18f as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/cf/87eb40b9fc1e4071a90f85325ea8e18f 2023-07-12 10:54:51,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/cf/b3a10d4d5a2b4aeb93401fd570ac032b, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 10:54:51,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 2ece6997ba836f0a85acf0b606aa7fc2 in 28ms, sequenceid=5, compaction requested=false 2023-07-12 10:54:51,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 10:54:51,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/cf/87eb40b9fc1e4071a90f85325ea8e18f, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 10:54:51,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 400c676ba43d17d655c093ebf1fa879a in 35ms, sequenceid=5, compaction requested=false 2023-07-12 10:54:51,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 10:54:51,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:54:51,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2. 2023-07-12 10:54:51,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 2ece6997ba836f0a85acf0b606aa7fc2: 2023-07-12 10:54:51,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 10:54:51,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:54:51,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a. 2023-07-12 10:54:51,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 400c676ba43d17d655c093ebf1fa879a: 2023-07-12 10:54:51,900 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2ece6997ba836f0a85acf0b606aa7fc2, regionState=CLOSED 2023-07-12 10:54:51,900 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159291900"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159291900"}]},"ts":"1689159291900"} 2023-07-12 10:54:51,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:54:51,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:54:51,902 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=400c676ba43d17d655c093ebf1fa879a, regionState=CLOSED 2023-07-12 10:54:51,902 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689159291902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159291902"}]},"ts":"1689159291902"} 2023-07-12 10:54:51,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-12 10:54:51,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 2ece6997ba836f0a85acf0b606aa7fc2, server=jenkins-hbase9.apache.org,46191,1689159209855 in 205 msec 2023-07-12 10:54:51,907 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-12 10:54:51,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2ece6997ba836f0a85acf0b606aa7fc2, UNASSIGN in 218 msec 2023-07-12 10:54:51,907 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 400c676ba43d17d655c093ebf1fa879a, server=jenkins-hbase9.apache.org,34083,1689159209755 in 205 msec 2023-07-12 10:54:51,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-12 10:54:51,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=400c676ba43d17d655c093ebf1fa879a, UNASSIGN in 218 msec 2023-07-12 10:54:51,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 10:54:52,002 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-12 10:54:52,005 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291007.2ece6997ba836f0a85acf0b606aa7fc2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:52,005 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689159291007.400c676ba43d17d655c093ebf1fa879a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:52,005 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 10:54:52,073 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=628f37876cc1873c2816a6a610899d76, ASSIGN}] 2023-07-12 10:54:52,075 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=628f37876cc1873c2816a6a610899d76, ASSIGN 2023-07-12 10:54:52,076 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=628f37876cc1873c2816a6a610899d76, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,46191,1689159209855; forceNewPlan=false, retain=false 2023-07-12 10:54:52,226 INFO [jenkins-hbase9:39303] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 10:54:52,229 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=628f37876cc1873c2816a6a610899d76, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:52,229 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689159292228"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159292228"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159292228"}]},"ts":"1689159292228"} 2023-07-12 10:54:52,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 628f37876cc1873c2816a6a610899d76, server=jenkins-hbase9.apache.org,46191,1689159209855}] 2023-07-12 10:54:52,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 10:54:52,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76. 2023-07-12 10:54:52,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 628f37876cc1873c2816a6a610899d76, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76.', STARTKEY => '', ENDKEY => ''} 2023-07-12 10:54:52,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76. service=AccessControlService 2023-07-12 10:54:52,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:54:52,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 628f37876cc1873c2816a6a610899d76 2023-07-12 10:54:52,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:54:52,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 628f37876cc1873c2816a6a610899d76 2023-07-12 10:54:52,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 628f37876cc1873c2816a6a610899d76 2023-07-12 10:54:52,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/.regioninfo 2023-07-12 10:54:52,398 INFO [StoreOpener-628f37876cc1873c2816a6a610899d76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 628f37876cc1873c2816a6a610899d76 2023-07-12 10:54:52,399 DEBUG [StoreOpener-628f37876cc1873c2816a6a610899d76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/cf 2023-07-12 10:54:52,399 DEBUG [StoreOpener-628f37876cc1873c2816a6a610899d76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/cf 2023-07-12 10:54:52,400 INFO [StoreOpener-628f37876cc1873c2816a6a610899d76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 628f37876cc1873c2816a6a610899d76 columnFamilyName cf 2023-07-12 10:54:52,438 DEBUG [StoreOpener-628f37876cc1873c2816a6a610899d76-1] regionserver.HStore(539): loaded hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/cf/87eb40b9fc1e4071a90f85325ea8e18f.400c676ba43d17d655c093ebf1fa879a->hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/cf/87eb40b9fc1e4071a90f85325ea8e18f-top 2023-07-12 10:54:52,441 DEBUG [StoreOpener-628f37876cc1873c2816a6a610899d76-1] regionserver.HStore(539): loaded hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/cf/b3a10d4d5a2b4aeb93401fd570ac032b.2ece6997ba836f0a85acf0b606aa7fc2->hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/cf/b3a10d4d5a2b4aeb93401fd570ac032b-top 2023-07-12 10:54:52,442 INFO [StoreOpener-628f37876cc1873c2816a6a610899d76-1] regionserver.HStore(310): Store=628f37876cc1873c2816a6a610899d76/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:54:52,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76 2023-07-12 10:54:52,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76 2023-07-12 10:54:52,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 628f37876cc1873c2816a6a610899d76 2023-07-12 10:54:52,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 628f37876cc1873c2816a6a610899d76; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73308165, jitterRate=0.09237678349018097}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:54:52,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 628f37876cc1873c2816a6a610899d76: 2023-07-12 10:54:52,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76., pid=77, masterSystemTime=1689159292383 2023-07-12 10:54:52,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76.,because compaction is disabled. 2023-07-12 10:54:52,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76. 2023-07-12 10:54:52,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76. 2023-07-12 10:54:52,466 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=628f37876cc1873c2816a6a610899d76, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:52,466 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689159292466"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159292466"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159292466"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159292466"}]},"ts":"1689159292466"} 2023-07-12 10:54:52,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-12 10:54:52,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 628f37876cc1873c2816a6a610899d76, server=jenkins-hbase9.apache.org,46191,1689159209855 in 237 msec 2023-07-12 10:54:52,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-12 10:54:52,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=628f37876cc1873c2816a6a610899d76, ASSIGN in 398 msec 2023-07-12 10:54:52,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2ece6997ba836f0a85acf0b606aa7fc2, 400c676ba43d17d655c093ebf1fa879a], force=true in 823 msec 2023-07-12 10:54:52,683 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0004_000001 (auth:SIMPLE) 2023-07-12 10:54:52,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 10:54:52,769 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-12 10:54:52,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 10:54:52,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159292770 (current time:1689159292770). 2023-07-12 10:54:52,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:54:52,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x4eaf2246 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:52,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@365df81c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:52,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:52,805 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:52,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4eaf2246 to 127.0.0.1:53362 2023-07-12 10:54:52,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:52,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x7521331e to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:54:52,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42ab82ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:54:52,882 DEBUG [hconnection-0x1bef1fbf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:52,886 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:52,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:54:52,899 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:54:52,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7521331e to 127.0.0.1:53362 2023-07-12 10:54:52,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:54:52,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 10:54:52,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:54:52,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 10:54:52,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 10:54:52,908 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 10:54:52,909 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689159892909 2023-07-12 10:54:52,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 10:54:52,909 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,913 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:54:52,913 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:54:52,914 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 10:54:52,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 10:54:52,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-12 10:54:52,917 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 10:54:52,922 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689159892922 2023-07-12 10:54:52,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,937 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 10:54:52,937 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:52,939 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-12 10:54:52,939 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-12 10:54:52,940 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,940 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,962 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:52,962 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:52,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:52,962 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:52,962 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:52,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:52,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:52,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:52,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:52,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:52,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,963 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:52,963 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:54:52,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 10:54:52,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,966 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 10:54:52,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 10:54:52,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,966 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 10:54:52,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 10:54:52,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,971 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 10:54:52,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,972 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 10:54:52,972 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:52,973 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,973 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 10:54:52,973 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:52,974 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:52,974 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 10:54:52,976 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:54:52,977 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 10:54:52,977 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 10:54:52,977 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 10:54:52,977 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 10:54:52,977 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 10:54:52,977 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 10:54:52,977 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 10:54:52,977 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 10:54:52,977 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 10:54:53,013 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:53,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 10:54:53,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:53,015 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:54:53,021 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,038 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,062 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,062 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:53,062 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,062 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,062 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:53,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:53,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:53,062 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:53,063 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,063 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:54:53,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:53,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:53,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:53,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-12 10:54:53,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32764b40[Count = 0] remaining members to acquire global barrier 2023-07-12 10:54:53,066 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-12 10:54:53,066 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,093 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,093 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,093 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,093 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,093 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:54:53,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,094 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 10:54:53,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,094 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 10:54:53,094 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 10:54:53,094 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 10:54:53,094 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,34083,1689159209755' in zk 2023-07-12 10:54:53,094 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 10:54:53,094 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,36981,1689159209821' in zk 2023-07-12 10:54:53,094 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:54:53,094 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:54:53,094 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76. 2023-07-12 10:54:53,094 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76. started... 2023-07-12 10:54:53,097 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 628f37876cc1873c2816a6a610899d76: 2023-07-12 10:54:53,098 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,098 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:54:53,098 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/cf/87eb40b9fc1e4071a90f85325ea8e18f.400c676ba43d17d655c093ebf1fa879a->hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/cf/87eb40b9fc1e4071a90f85325ea8e18f-top, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/cf/b3a10d4d5a2b4aeb93401fd570ac032b.2ece6997ba836f0a85acf0b606aa7fc2->hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/cf/b3a10d4d5a2b4aeb93401fd570ac032b-top] hfiles 2023-07-12 10:54:53,098 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/cf/87eb40b9fc1e4071a90f85325ea8e18f.400c676ba43d17d655c093ebf1fa879a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,099 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/cf/b3a10d4d5a2b4aeb93401fd570ac032b.2ece6997ba836f0a85acf0b606aa7fc2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,108 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76. completed. 2023-07-12 10:54:53,108 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76. 2023-07-12 10:54:53,108 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:54:53,108 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:54:53,108 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,109 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 10:54:53,109 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,46191,1689159209855' in zk 2023-07-12 10:54:53,115 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 10:54:53,115 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:53,116 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 10:54:53,117 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:53,116 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 10:54:53,117 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 10:54:53,215 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:53,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 10:54:53,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:54:53,217 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:54:53,292 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 10:54:53,292 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,293 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:53,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,293 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 10:54:53,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:53,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:53,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:53,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:53,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:53,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:53,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:53,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:53,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:53,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,46191,1689159209855': 2023-07-12 10:54:53,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-12 10:54:53,297 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-12 10:54:53,297 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:54:53,297 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:54:53,297 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,297 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:54:53,338 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,338 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,338 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,338 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:54:53,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:54:53,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,339 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:53,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,339 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:53,339 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:53,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,339 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:53,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:53,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:53,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:54:53,340 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:53,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:53,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:53,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:53,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:53,340 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:54:53,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,344 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:53,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:54:53,344 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:53,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,345 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:53,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:53,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,354 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:53,354 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:53,354 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,354 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:54:53,354 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:53,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:53,354 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:53,354 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:54:53,354 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,354 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:54:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:53,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:53,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:53,354 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,355 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:53,355 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:53,355 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,355 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:54:53,355 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,355 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:54:53,355 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:54:53,355 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,355 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:54:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:54:53,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:53,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:53,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:54:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:54:53,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,439 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-12 10:54:53,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,439 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689159292909Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689159293355 (+446 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689159293355Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689159293360 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689159293377 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689159293439 (+62 ms) 2023-07-12 10:54:53,443 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 10:54:53,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 530 msec 2023-07-12 10:54:53,517 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:54:53,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 10:54:53,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:54:53,518 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159293518 2023-07-12 10:54:53,519 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44111, tgtDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159293518, rawTgtDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159293518, srcFsUri=hdfs://localhost:44111, srcDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:54:53,544 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:54:53,545 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-325738947_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159293518, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159293518/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,545 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648, snapshotDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-12 10:54:53,564 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159293518/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:54:53,620 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:53,621 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:53,621 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:53,622 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:53,622 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:53,622 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:53,622 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:53,697 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/hadoop-1587646165493215666.jar 2023-07-12 10:54:53,698 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:53,698 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:53,699 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:53,699 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:53,699 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:53,700 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:54:53,700 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:54:53,701 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:54:53,701 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:54:53,701 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:54:53,702 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:54:53,702 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:54:53,703 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:54:53,704 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:54:53,704 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:54:53,705 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:54:53,705 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:53,706 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:53,706 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:53,707 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:53,707 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:54:53,707 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:53,708 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:54:54,129 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:54:55,219 WARN [Listener at jenkins-hbase9.apache.org/45227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:54:55,226 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-12 10:54:55,228 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-12 10:54:55,332 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:55,332 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:54:55,488 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0005_000001 (auth:SIMPLE) 2023-07-12 10:55:01,380 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0005_000001 (auth:SIMPLE) 2023-07-12 10:55:03,677 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0005_000001 (auth:SIMPLE) 2023-07-12 10:55:07,311 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0005_000001 (auth:SIMPLE) 2023-07-12 10:55:08,498 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:55:08,502 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:55:08,518 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,518 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:55:08,521 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:55:08,521 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_272028698_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,522 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 10:55:08,522 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 10:55:08,522 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_272028698_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159293518/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159293518/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,523 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159293518/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 10:55:08,523 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159293518/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 10:55:08,534 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,540 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159308540"}]},"ts":"1689159308540"} 2023-07-12 10:55:08,544 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-12 10:55:08,546 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-12 10:55:08,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=628f37876cc1873c2816a6a610899d76, UNASSIGN}] 2023-07-12 10:55:08,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 10:55:08,549 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=628f37876cc1873c2816a6a610899d76, UNASSIGN 2023-07-12 10:55:08,551 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=628f37876cc1873c2816a6a610899d76, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:08,551 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689159308551"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159308551"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159308551"}]},"ts":"1689159308551"} 2023-07-12 10:55:08,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 628f37876cc1873c2816a6a610899d76, server=jenkins-hbase9.apache.org,46191,1689159209855}] 2023-07-12 10:55:08,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 10:55:08,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 628f37876cc1873c2816a6a610899d76 2023-07-12 10:55:08,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 628f37876cc1873c2816a6a610899d76, disabling compactions & flushes 2023-07-12 10:55:08,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76. 2023-07-12 10:55:08,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76. 2023-07-12 10:55:08,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76. after waiting 0 ms 2023-07-12 10:55:08,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76. 2023-07-12 10:55:08,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-12 10:55:08,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:08,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76. 2023-07-12 10:55:08,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 628f37876cc1873c2816a6a610899d76: 2023-07-12 10:55:08,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 628f37876cc1873c2816a6a610899d76 2023-07-12 10:55:08,746 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=628f37876cc1873c2816a6a610899d76, regionState=CLOSED 2023-07-12 10:55:08,747 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689159308746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159308746"}]},"ts":"1689159308746"} 2023-07-12 10:55:08,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-12 10:55:08,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 628f37876cc1873c2816a6a610899d76, server=jenkins-hbase9.apache.org,46191,1689159209855 in 198 msec 2023-07-12 10:55:08,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-12 10:55:08,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=628f37876cc1873c2816a6a610899d76, UNASSIGN in 211 msec 2023-07-12 10:55:08,762 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159308762"}]},"ts":"1689159308762"} 2023-07-12 10:55:08,768 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-12 10:55:08,802 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-12 10:55:08,804 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 269 msec 2023-07-12 10:55:08,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 10:55:08,851 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-12 10:55:08,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,861 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,862 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,864 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,869 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76 2023-07-12 10:55:08,870 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:55:08,870 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:55:08,872 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/recovered.edits] 2023-07-12 10:55:08,875 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/recovered.edits] 2023-07-12 10:55:08,875 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/recovered.edits] 2023-07-12 10:55:08,881 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/cf/87eb40b9fc1e4071a90f85325ea8e18f to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/cf/87eb40b9fc1e4071a90f85325ea8e18f 2023-07-12 10:55:08,882 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/cf/87eb40b9fc1e4071a90f85325ea8e18f.400c676ba43d17d655c093ebf1fa879a to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/cf/87eb40b9fc1e4071a90f85325ea8e18f.400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:55:08,885 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/cf/b3a10d4d5a2b4aeb93401fd570ac032b.2ece6997ba836f0a85acf0b606aa7fc2 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/cf/b3a10d4d5a2b4aeb93401fd570ac032b.2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:55:08,889 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/recovered.edits/12.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76/recovered.edits/12.seqid 2023-07-12 10:55:08,890 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/628f37876cc1873c2816a6a610899d76 2023-07-12 10:55:08,895 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/recovered.edits/8.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a/recovered.edits/8.seqid 2023-07-12 10:55:08,900 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/400c676ba43d17d655c093ebf1fa879a 2023-07-12 10:55:08,900 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/cf/b3a10d4d5a2b4aeb93401fd570ac032b to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/cf/b3a10d4d5a2b4aeb93401fd570ac032b 2023-07-12 10:55:08,906 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/recovered.edits/8.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2/recovered.edits/8.seqid 2023-07-12 10:55:08,907 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2ece6997ba836f0a85acf0b606aa7fc2 2023-07-12 10:55:08,907 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 10:55:08,922 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,928 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-12 10:55:08,933 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,933 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,933 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,933 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 10:55:08,934 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 10:55:08,935 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,978 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-12 10:55:08,979 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,979 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-12 10:55:08,980 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159308979"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:08,985 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-12 10:55:08,985 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 628f37876cc1873c2816a6a610899d76, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689159291008.628f37876cc1873c2816a6a610899d76.', STARTKEY => '', ENDKEY => ''}] 2023-07-12 10:55:08,986 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-12 10:55:08,986 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159308986"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:08,987 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,987 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:08,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-12 10:55:08,987 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:08,987 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:08,987 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:08,987 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:08,987 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 10:55:08,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-12 10:55:08,987 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 10:55:08,989 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:08,989 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:08,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 10:55:08,989 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:08,989 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:08,993 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-12 10:55:09,057 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:09,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 205 msec 2023-07-12 10:55:09,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 10:55:09,092 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-12 10:55:09,093 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 10:55:09,099 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159309099"}]},"ts":"1689159309099"} 2023-07-12 10:55:09,102 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-12 10:55:09,148 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-12 10:55:09,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ca6e71e5c1817d42dd2306396a42e4e, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fc2877dc2e9e601772da02f2861e3a, UNASSIGN}] 2023-07-12 10:55:09,199 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ca6e71e5c1817d42dd2306396a42e4e, UNASSIGN 2023-07-12 10:55:09,199 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fc2877dc2e9e601772da02f2861e3a, UNASSIGN 2023-07-12 10:55:09,200 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=6ca6e71e5c1817d42dd2306396a42e4e, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:09,200 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=08fc2877dc2e9e601772da02f2861e3a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:09,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 10:55:09,200 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159309200"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159309200"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159309200"}]},"ts":"1689159309200"} 2023-07-12 10:55:09,200 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159309200"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159309200"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159309200"}]},"ts":"1689159309200"} 2023-07-12 10:55:09,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 6ca6e71e5c1817d42dd2306396a42e4e, server=jenkins-hbase9.apache.org,34083,1689159209755}] 2023-07-12 10:55:09,203 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 08fc2877dc2e9e601772da02f2861e3a, server=jenkins-hbase9.apache.org,46191,1689159209855}] 2023-07-12 10:55:09,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 6ca6e71e5c1817d42dd2306396a42e4e 2023-07-12 10:55:09,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 6ca6e71e5c1817d42dd2306396a42e4e, disabling compactions & flushes 2023-07-12 10:55:09,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:55:09,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:55:09,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. after waiting 0 ms 2023-07-12 10:55:09,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:55:09,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 08fc2877dc2e9e601772da02f2861e3a 2023-07-12 10:55:09,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 08fc2877dc2e9e601772da02f2861e3a, disabling compactions & flushes 2023-07-12 10:55:09,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:55:09,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:55:09,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. after waiting 0 ms 2023-07-12 10:55:09,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:55:09,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:55:09,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:09,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e. 2023-07-12 10:55:09,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 6ca6e71e5c1817d42dd2306396a42e4e: 2023-07-12 10:55:09,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:55:09,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 6ca6e71e5c1817d42dd2306396a42e4e 2023-07-12 10:55:09,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:09,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a. 2023-07-12 10:55:09,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 08fc2877dc2e9e601772da02f2861e3a: 2023-07-12 10:55:09,382 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=6ca6e71e5c1817d42dd2306396a42e4e, regionState=CLOSED 2023-07-12 10:55:09,383 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159309382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159309382"}]},"ts":"1689159309382"} 2023-07-12 10:55:09,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 08fc2877dc2e9e601772da02f2861e3a 2023-07-12 10:55:09,385 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=08fc2877dc2e9e601772da02f2861e3a, regionState=CLOSED 2023-07-12 10:55:09,385 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689159309385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159309385"}]},"ts":"1689159309385"} 2023-07-12 10:55:09,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-12 10:55:09,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 6ca6e71e5c1817d42dd2306396a42e4e, server=jenkins-hbase9.apache.org,34083,1689159209755 in 182 msec 2023-07-12 10:55:09,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-12 10:55:09,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 08fc2877dc2e9e601772da02f2861e3a, server=jenkins-hbase9.apache.org,46191,1689159209855 in 184 msec 2023-07-12 10:55:09,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ca6e71e5c1817d42dd2306396a42e4e, UNASSIGN in 197 msec 2023-07-12 10:55:09,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 10:55:09,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-12 10:55:09,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08fc2877dc2e9e601772da02f2861e3a, UNASSIGN in 198 msec 2023-07-12 10:55:09,419 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159309419"}]},"ts":"1689159309419"} 2023-07-12 10:55:09,421 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-12 10:55:09,433 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-12 10:55:09,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 340 msec 2023-07-12 10:55:09,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 10:55:09,704 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-12 10:55:09,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,709 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,712 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,719 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,724 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e 2023-07-12 10:55:09,724 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a 2023-07-12 10:55:09,732 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/recovered.edits] 2023-07-12 10:55:09,732 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/recovered.edits] 2023-07-12 10:55:09,737 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/cf/20ddea755a3d4b4fa917e3bfb46cf990 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/cf/20ddea755a3d4b4fa917e3bfb46cf990 2023-07-12 10:55:09,737 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/cf/81df256acd1d4d08bfed18ccd7cc77a7 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/cf/81df256acd1d4d08bfed18ccd7cc77a7 2023-07-12 10:55:09,740 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,740 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,740 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 10:55:09,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 10:55:09,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 10:55:09,744 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/recovered.edits/9.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e/recovered.edits/9.seqid 2023-07-12 10:55:09,744 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/recovered.edits/9.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a/recovered.edits/9.seqid 2023-07-12 10:55:09,745 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ca6e71e5c1817d42dd2306396a42e4e 2023-07-12 10:55:09,745 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08fc2877dc2e9e601772da02f2861e3a 2023-07-12 10:55:09,745 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 10:55:09,745 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 10:55:09,745 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,746 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-12 10:55:09,764 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,764 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:09,764 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-12 10:55:09,764 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 10:55:09,764 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:09,764 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,764 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:09,764 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,765 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:09,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 10:55:09,783 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712b41829a4da3d44e7be2f977d7024a8ff to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712b41829a4da3d44e7be2f977d7024a8ff 2023-07-12 10:55:09,785 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712f9f70714e64041eb9aca2b5191f98ff6 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230712f9f70714e64041eb9aca2b5191f98ff6 2023-07-12 10:55:09,786 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 10:55:09,788 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,790 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-12 10:55:09,792 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-12 10:55:09,793 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,793 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-12 10:55:09,793 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159309793"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:09,793 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159309793"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:09,795 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 10:55:09,795 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6ca6e71e5c1817d42dd2306396a42e4e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689159288845.6ca6e71e5c1817d42dd2306396a42e4e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 08fc2877dc2e9e601772da02f2861e3a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689159288845.08fc2877dc2e9e601772da02f2861e3a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 10:55:09,795 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-12 10:55:09,795 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159309795"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:09,797 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-12 10:55:09,826 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 121 msec 2023-07-12 10:55:09,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 10:55:09,867 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-12 10:55:09,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 10:55:09,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 10:55:09,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 10:55:09,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-12 10:55:09,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 10:55:09,935 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 747) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase9.apache.org/172.31.2.10:45949 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:34954 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4215 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:52394 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-597864569_1 at /127.0.0.1:52370 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:57382 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-597864569_1 at /127.0.0.1:57366 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 911), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=625 (was 409) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=5949 (was 6414) 2023-07-12 10:55:09,936 WARN [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-12 10:55:09,966 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=625, ProcessCount=182, AvailableMemoryMB=5944 2023-07-12 10:55:09,966 WARN [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-12 10:55:09,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 10:55:09,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:09,973 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:55:09,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-12 10:55:09,980 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:55:09,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 10:55:09,983 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7 2023-07-12 10:55:09,983 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b 2023-07-12 10:55:09,984 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7 empty. 2023-07-12 10:55:09,985 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7 2023-07-12 10:55:09,985 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b empty. 2023-07-12 10:55:09,986 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b 2023-07-12 10:55:09,986 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 10:55:10,072 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 10:55:10,075 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => acb10e44b7103b22c48ccc3fec8732c7, NAME => 'testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:55:10,075 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => a4c679eddf4c4684950f66e64899547b, NAME => 'testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:55:10,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 10:55:10,113 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:10,113 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing acb10e44b7103b22c48ccc3fec8732c7, disabling compactions & flushes 2023-07-12 10:55:10,113 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:10,113 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:10,113 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. after waiting 0 ms 2023-07-12 10:55:10,113 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:10,113 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:10,113 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for acb10e44b7103b22c48ccc3fec8732c7: 2023-07-12 10:55:10,122 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:10,122 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing a4c679eddf4c4684950f66e64899547b, disabling compactions & flushes 2023-07-12 10:55:10,122 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:10,122 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:10,122 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. after waiting 0 ms 2023-07-12 10:55:10,122 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:10,123 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:10,123 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for a4c679eddf4c4684950f66e64899547b: 2023-07-12 10:55:10,125 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:55:10,126 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159310126"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159310126"}]},"ts":"1689159310126"} 2023-07-12 10:55:10,126 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159310126"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159310126"}]},"ts":"1689159310126"} 2023-07-12 10:55:10,128 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:55:10,129 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:55:10,129 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159310129"}]},"ts":"1689159310129"} 2023-07-12 10:55:10,130 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 10:55:10,136 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:55:10,137 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:55:10,137 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:55:10,137 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:55:10,137 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:55:10,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=acb10e44b7103b22c48ccc3fec8732c7, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a4c679eddf4c4684950f66e64899547b, ASSIGN}] 2023-07-12 10:55:10,140 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a4c679eddf4c4684950f66e64899547b, ASSIGN 2023-07-12 10:55:10,140 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=acb10e44b7103b22c48ccc3fec8732c7, ASSIGN 2023-07-12 10:55:10,141 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a4c679eddf4c4684950f66e64899547b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46191,1689159209855; forceNewPlan=false, retain=false 2023-07-12 10:55:10,141 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=acb10e44b7103b22c48ccc3fec8732c7, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36981,1689159209821; forceNewPlan=false, retain=false 2023-07-12 10:55:10,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 10:55:10,291 INFO [jenkins-hbase9:39303] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:55:10,294 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a4c679eddf4c4684950f66e64899547b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,294 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=acb10e44b7103b22c48ccc3fec8732c7, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,294 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159310294"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159310294"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159310294"}]},"ts":"1689159310294"} 2023-07-12 10:55:10,294 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159310294"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159310294"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159310294"}]},"ts":"1689159310294"} 2023-07-12 10:55:10,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure acb10e44b7103b22c48ccc3fec8732c7, server=jenkins-hbase9.apache.org,36981,1689159209821}] 2023-07-12 10:55:10,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure a4c679eddf4c4684950f66e64899547b, server=jenkins-hbase9.apache.org,46191,1689159209855}] 2023-07-12 10:55:10,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:10,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a4c679eddf4c4684950f66e64899547b, NAME => 'testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 10:55:10,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. service=AccessControlService 2023-07-12 10:55:10,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:55:10,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState a4c679eddf4c4684950f66e64899547b 2023-07-12 10:55:10,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:10,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a4c679eddf4c4684950f66e64899547b 2023-07-12 10:55:10,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a4c679eddf4c4684950f66e64899547b 2023-07-12 10:55:10,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:10,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => acb10e44b7103b22c48ccc3fec8732c7, NAME => 'testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 10:55:10,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. service=AccessControlService 2023-07-12 10:55:10,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:55:10,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState acb10e44b7103b22c48ccc3fec8732c7 2023-07-12 10:55:10,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:10,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for acb10e44b7103b22c48ccc3fec8732c7 2023-07-12 10:55:10,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for acb10e44b7103b22c48ccc3fec8732c7 2023-07-12 10:55:10,465 INFO [StoreOpener-a4c679eddf4c4684950f66e64899547b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a4c679eddf4c4684950f66e64899547b 2023-07-12 10:55:10,466 INFO [StoreOpener-acb10e44b7103b22c48ccc3fec8732c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region acb10e44b7103b22c48ccc3fec8732c7 2023-07-12 10:55:10,467 DEBUG [StoreOpener-a4c679eddf4c4684950f66e64899547b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/cf 2023-07-12 10:55:10,467 DEBUG [StoreOpener-a4c679eddf4c4684950f66e64899547b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/cf 2023-07-12 10:55:10,467 INFO [StoreOpener-a4c679eddf4c4684950f66e64899547b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4c679eddf4c4684950f66e64899547b columnFamilyName cf 2023-07-12 10:55:10,467 DEBUG [StoreOpener-acb10e44b7103b22c48ccc3fec8732c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/cf 2023-07-12 10:55:10,468 DEBUG [StoreOpener-acb10e44b7103b22c48ccc3fec8732c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/cf 2023-07-12 10:55:10,468 INFO [StoreOpener-acb10e44b7103b22c48ccc3fec8732c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acb10e44b7103b22c48ccc3fec8732c7 columnFamilyName cf 2023-07-12 10:55:10,473 INFO [StoreOpener-acb10e44b7103b22c48ccc3fec8732c7-1] regionserver.HStore(310): Store=acb10e44b7103b22c48ccc3fec8732c7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:55:10,474 INFO [StoreOpener-a4c679eddf4c4684950f66e64899547b-1] regionserver.HStore(310): Store=a4c679eddf4c4684950f66e64899547b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:55:10,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7 2023-07-12 10:55:10,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b 2023-07-12 10:55:10,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b 2023-07-12 10:55:10,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7 2023-07-12 10:55:10,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a4c679eddf4c4684950f66e64899547b 2023-07-12 10:55:10,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for acb10e44b7103b22c48ccc3fec8732c7 2023-07-12 10:55:10,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:55:10,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:55:10,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a4c679eddf4c4684950f66e64899547b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58980538, jitterRate=-0.12112149596214294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:55:10,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened acb10e44b7103b22c48ccc3fec8732c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66206975, jitterRate=-0.013439193367958069}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:55:10,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a4c679eddf4c4684950f66e64899547b: 2023-07-12 10:55:10,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for acb10e44b7103b22c48ccc3fec8732c7: 2023-07-12 10:55:10,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7., pid=93, masterSystemTime=1689159310455 2023-07-12 10:55:10,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b., pid=94, masterSystemTime=1689159310456 2023-07-12 10:55:10,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:10,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:10,497 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=acb10e44b7103b22c48ccc3fec8732c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:10,497 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159310497"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159310497"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159310497"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159310497"}]},"ts":"1689159310497"} 2023-07-12 10:55:10,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:10,498 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=a4c679eddf4c4684950f66e64899547b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,498 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159310498"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159310498"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159310498"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159310498"}]},"ts":"1689159310498"} 2023-07-12 10:55:10,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-12 10:55:10,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure acb10e44b7103b22c48ccc3fec8732c7, server=jenkins-hbase9.apache.org,36981,1689159209821 in 201 msec 2023-07-12 10:55:10,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-12 10:55:10,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure a4c679eddf4c4684950f66e64899547b, server=jenkins-hbase9.apache.org,46191,1689159209855 in 201 msec 2023-07-12 10:55:10,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=acb10e44b7103b22c48ccc3fec8732c7, ASSIGN in 364 msec 2023-07-12 10:55:10,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-12 10:55:10,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a4c679eddf4c4684950f66e64899547b, ASSIGN in 365 msec 2023-07-12 10:55:10,505 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:55:10,505 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159310505"}]},"ts":"1689159310505"} 2023-07-12 10:55:10,506 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 10:55:10,508 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:55:10,509 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-12 10:55:10,510 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 10:55:10,512 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:10,512 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:10,512 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:10,512 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:10,513 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:10,513 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:10,514 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:10,514 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:10,515 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 545 msec 2023-07-12 10:55:10,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 10:55:10,585 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-12 10:55:10,588 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 10:55:10,588 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:10,592 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:55:10,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:55:10,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159310607 (current time:1689159310607). 2023-07-12 10:55:10,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:55:10,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x2ec4e7e0 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:10,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d116cd9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:10,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:10,622 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:10,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ec4e7e0 to 127.0.0.1:53362 2023-07-12 10:55:10,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:10,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x2b572fa9 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:10,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22a526c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:10,728 DEBUG [hconnection-0x3444e1ed-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:10,732 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:10,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:10,741 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:10,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b572fa9 to 127.0.0.1:53362 2023-07-12 10:55:10,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:10,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 10:55:10,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:55:10,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:55:10,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:55:10,753 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:55:10,754 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689159910754 2023-07-12 10:55:10,754 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 10:55:10,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:55:10,756 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:55:10,756 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:55:10,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 10:55:10,761 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:55:10,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 14 msec 2023-07-12 10:55:10,767 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 10:55:10,767 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689159910767 2023-07-12 10:55:10,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,814 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-12 10:55:10,814 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:10,816 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 10:55:10,816 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 10:55:10,817 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,817 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,821 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,822 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:10,822 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:10,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:10,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:10,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:10,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:10,822 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:10,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:10,822 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:10,822 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,823 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,823 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:55:10,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 10:55:10,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,824 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 10:55:10,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 10:55:10,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,824 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 10:55:10,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 10:55:10,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,825 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 10:55:10,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,838 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 10:55:10,838 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:10,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,842 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 10:55:10,842 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:10,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,862 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 10:55:10,862 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:10,860 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 10:55:10,862 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 10:55:10,862 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 10:55:10,859 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 10:55:10,862 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 10:55:10,862 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 10:55:10,858 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:10,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:55:10,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:10,865 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 10:55:10,865 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 10:55:10,865 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 10:55:10,866 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:55:10,867 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:10,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:10,868 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,868 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:10,868 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,868 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,869 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,869 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:10,870 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,870 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:10,870 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,870 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:10,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 10:55:10,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@663aa3cf[Count = 1] remaining members to acquire global barrier 2023-07-12 10:55:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:10,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:10,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:10,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:10,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:10,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 10:55:10,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@663aa3cf[Count = 0] remaining members to acquire global barrier 2023-07-12 10:55:10,887 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 10:55:10,887 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,888 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,888 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,888 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,888 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:55:10,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,889 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:55:10,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,889 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:55:10,889 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 10:55:10,889 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,34083,1689159209755' in zk 2023-07-12 10:55:10,889 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,890 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,890 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:55:10,891 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 10:55:10,891 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:10,891 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 10:55:10,901 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:10,901 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:10,903 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:10,903 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:10,903 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:10,903 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:10,903 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. started... 2023-07-12 10:55:10,903 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. started... 2023-07-12 10:55:10,905 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for acb10e44b7103b22c48ccc3fec8732c7: 2023-07-12 10:55:10,905 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a4c679eddf4c4684950f66e64899547b: 2023-07-12 10:55:10,905 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,905 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,905 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:10,905 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:10,905 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:55:10,905 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:55:10,924 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. completed. 2023-07-12 10:55:10,924 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:10,924 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:10,924 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:10,924 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,924 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 10:55:10,924 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,36981,1689159209821' in zk 2023-07-12 10:55:10,926 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 10:55:10,926 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:10,926 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 10:55:10,928 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:10,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:10,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:10,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:10,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:10,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:10,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:10,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,36981,1689159209821': 2023-07-12 10:55:10,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 10:55:10,947 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. completed. 2023-07-12 10:55:10,947 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:10,947 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:10,947 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:10,947 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,947 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 10:55:10,947 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,46191,1689159209855' in zk 2023-07-12 10:55:10,949 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,949 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 10:55:10,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:10,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:10,949 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:10,950 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 10:55:10,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:10,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:10,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:10,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:10,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,46191,1689159209855': 2023-07-12 10:55:10,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 10:55:10,957 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 10:55:10,957 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:55:10,957 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:55:10,957 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,957 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:55:10,960 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,960 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,960 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,960 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:10,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:10,960 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,960 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:10,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:10,960 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:10,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:10,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:10,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:10,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:10,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,962 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,963 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:10,963 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:10,966 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:10,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,967 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:10,967 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,971 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:10,971 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:10,971 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:10,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:10,971 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:10,972 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:10,971 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:10,972 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:10,972 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 10:55:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:10,972 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:10,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,972 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:10,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:10,972 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,976 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,976 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:10,976 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,976 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:10,976 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:10,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:10,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:10,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:10,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 10:55:10,976 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:10,976 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:10,976 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,976 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:10,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:10,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 10:55:10,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:10,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,066 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:11,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:55:11,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:11,067 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:55:11,080 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 10:55:11,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,080 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689159310754Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689159310999 (+245 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689159310999Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689159310999Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689159311013 (+14 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689159311042 (+29 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689159311080 (+38 ms) 2023-07-12 10:55:11,084 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 10:55:11,086 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 328 msec 2023-07-12 10:55:11,368 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:11,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:55:11,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:55:11,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36981] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:55:11,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46191] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:55:11,381 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 10:55:11,381 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:11,382 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:55:11,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:55:11,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159311394 (current time:1689159311394). 2023-07-12 10:55:11,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:55:11,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x66fca0bf to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:11,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75a47e04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:11,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:11,407 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45166, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:11,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66fca0bf to 127.0.0.1:53362 2023-07-12 10:55:11,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:11,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x255dae49 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:11,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26a70b05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:11,522 DEBUG [hconnection-0x7025058b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:11,523 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:11,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:11,530 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:11,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x255dae49 to 127.0.0.1:53362 2023-07-12 10:55:11,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:11,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 10:55:11,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:55:11,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:55:11,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:55:11,537 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:55:11,538 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689159911538 2023-07-12 10:55:11,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 10:55:11,538 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 10:55:11,539 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:55:11,539 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:55:11,540 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 10:55:11,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 10:55:11,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-12 10:55:11,542 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 10:55:11,543 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689159911543 2023-07-12 10:55:11,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,577 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-12 10:55:11,577 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:11,579 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 10:55:11,579 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 10:55:11,580 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,580 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,581 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:11,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:11,581 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:11,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:11,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:11,581 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:11,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:11,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:11,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:11,581 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,591 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,591 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,592 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,592 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:55:11,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 10:55:11,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 10:55:11,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,592 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 10:55:11,592 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 10:55:11,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 10:55:11,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,593 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 10:55:11,593 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,594 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 10:55:11,594 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:11,598 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,599 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 10:55:11,599 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 10:55:11,599 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:11,599 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 10:55:11,601 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 10:55:11,601 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 10:55:11,599 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,601 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 10:55:11,601 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 10:55:11,601 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:11,601 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 10:55:11,606 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 10:55:11,606 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 10:55:11,606 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 10:55:11,607 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,607 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:11,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:11,608 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,608 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,608 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,608 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:11,608 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:11,608 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,608 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,608 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:11,608 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:11,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:11,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:11,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:11,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 10:55:11,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@787928c6[Count = 1] remaining members to acquire global barrier 2023-07-12 10:55:11,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:11,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:11,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:11,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:11,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:11,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:11,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 10:55:11,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@787928c6[Count = 0] remaining members to acquire global barrier 2023-07-12 10:55:11,613 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 10:55:11,613 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,619 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,620 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:55:11,620 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:55:11,620 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,620 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 10:55:11,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,620 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,34083,1689159209755' in zk 2023-07-12 10:55:11,620 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 10:55:11,620 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,620 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:55:11,621 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:11,621 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:11,621 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 10:55:11,622 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:11,622 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:11,622 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 10:55:11,622 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. started... 2023-07-12 10:55:11,622 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a4c679eddf4c4684950f66e64899547b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 10:55:11,625 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:11,627 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:11,627 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:11,627 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. started... 2023-07-12 10:55:11,627 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegion(2745): Flushing acb10e44b7103b22c48ccc3fec8732c7 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 10:55:11,639 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:11,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:55:11,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:11,641 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:55:11,696 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071231ccb6e9112c4d87bd84e72cda7eafca to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071231ccb6e9112c4d87bd84e72cda7eafca 2023-07-12 10:55:11,705 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307127f09179312e44045b568642ac325e32b to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307127f09179312e44045b568642ac325e32b 2023-07-12 10:55:11,731 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/.tmp/cf/8e443484faa94e138b10d9de11942728 2023-07-12 10:55:11,736 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/.tmp/cf/6e755da913a847e4953905105c43390f 2023-07-12 10:55:11,742 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/.tmp/cf/8e443484faa94e138b10d9de11942728 as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/cf/8e443484faa94e138b10d9de11942728 2023-07-12 10:55:11,745 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/.tmp/cf/6e755da913a847e4953905105c43390f as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/cf/6e755da913a847e4953905105c43390f 2023-07-12 10:55:11,751 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/cf/8e443484faa94e138b10d9de11942728, entries=4, sequenceid=6, filesize=5.6 K 2023-07-12 10:55:11,752 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for acb10e44b7103b22c48ccc3fec8732c7 in 125ms, sequenceid=6, compaction requested=false 2023-07-12 10:55:11,752 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-12 10:55:11,753 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for acb10e44b7103b22c48ccc3fec8732c7: 2023-07-12 10:55:11,753 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,753 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:11,753 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/cf/8e443484faa94e138b10d9de11942728] hfiles 2023-07-12 10:55:11,753 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/cf/8e443484faa94e138b10d9de11942728 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,756 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/cf/6e755da913a847e4953905105c43390f, entries=46, sequenceid=6, filesize=12.9 K 2023-07-12 10:55:11,759 INFO [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a4c679eddf4c4684950f66e64899547b in 137ms, sequenceid=6, compaction requested=false 2023-07-12 10:55:11,770 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a4c679eddf4c4684950f66e64899547b: 2023-07-12 10:55:11,770 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,775 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:11,775 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/cf/6e755da913a847e4953905105c43390f] hfiles 2023-07-12 10:55:11,775 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/cf/6e755da913a847e4953905105c43390f for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,789 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. completed. 2023-07-12 10:55:11,790 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:11,790 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:11,790 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:11,790 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,790 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 10:55:11,790 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,36981,1689159209821' in zk 2023-07-12 10:55:11,792 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,792 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 10:55:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:11,792 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:11,792 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 10:55:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:11,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:11,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:11,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:11,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,36981,1689159209821': 2023-07-12 10:55:11,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 10:55:11,808 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. completed. 2023-07-12 10:55:11,808 DEBUG [rs(jenkins-hbase9.apache.org,46191,1689159209855)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:11,808 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:11,808 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:11,808 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,808 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 10:55:11,808 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,46191,1689159209855' in zk 2023-07-12 10:55:11,810 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,810 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 10:55:11,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:11,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:11,810 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:11,810 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 10:55:11,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:11,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:11,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:11,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:11,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:11,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,46191,1689159209855': 2023-07-12 10:55:11,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 10:55:11,819 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 10:55:11,819 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:55:11,819 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:55:11,819 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,819 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:55:11,821 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,821 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:11,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,822 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,822 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:11,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,822 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:11,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:11,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,822 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:11,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:11,822 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:11,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:11,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:11,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:11,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:11,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:11,824 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:11,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,824 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:11,825 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:11,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:11,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,828 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:11,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:11,828 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,829 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,831 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:11,831 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:11,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:11,832 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:11,832 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,832 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,832 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:11,832 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:11,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:11,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:11,832 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:11,832 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:11,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:11,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:11,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:11,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:11,834 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:11,834 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:11,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,832 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:11,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:11,835 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:11,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:11,835 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 10:55:11,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:11,835 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,835 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:11,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,835 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:11,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 10:55:11,835 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,836 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071231ccb6e9112c4d87bd84e72cda7eafca, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307127f09179312e44045b568642ac325e32b] mob files 2023-07-12 10:55:11,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071231ccb6e9112c4d87bd84e72cda7eafca 2023-07-12 10:55:11,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307127f09179312e44045b568642ac325e32b 2023-07-12 10:55:11,841 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:11,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:55:11,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:11,842 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:55:11,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:11,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,061 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 10:55:12,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,069 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689159311538Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689159311874 (+336 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689159311874Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689159311874Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689159311902 (+28 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689159311964 (+62 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689159312061 (+97 ms) 2023-07-12 10:55:12,076 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 10:55:12,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 537 msec 2023-07-12 10:55:12,142 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:12,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 10:55:12,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:55:12,144 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159312144 2023-07-12 10:55:12,144 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44111, tgtDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159312144, rawTgtDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159312144, srcFsUri=hdfs://localhost:44111, srcDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:55:12,173 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:55:12,173 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2053874014_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159312144, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159312144/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,173 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648, snapshotDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-12 10:55:12,194 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159312144/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:12,244 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:12,244 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:12,245 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:12,245 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:12,246 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:12,246 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:12,247 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:12,338 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/hadoop-5114406917023395219.jar 2023-07-12 10:55:12,339 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:12,339 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:12,340 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:12,340 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:12,341 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:12,341 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:12,342 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:55:12,343 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:55:12,343 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:55:12,344 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:55:12,344 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:55:12,345 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:55:12,345 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:55:12,346 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:55:12,346 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:55:12,347 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:55:12,347 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:12,348 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:12,348 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:55:12,349 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:12,349 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:12,350 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:55:12,350 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:55:13,131 WARN [Listener at jenkins-hbase9.apache.org/45227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:55:13,134 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-12 10:55:13,533 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:55:13,533 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:55:13,537 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0005_000001 (auth:SIMPLE) 2023-07-12 10:55:13,702 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0006_000001 (auth:SIMPLE) 2023-07-12 10:55:14,428 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:55:19,919 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0006_000001 (auth:SIMPLE) 2023-07-12 10:55:22,560 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:55:22,562 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:55:22,590 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:22,590 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:55:22,591 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:55:22,591 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_272028698_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:22,592 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 10:55:22,592 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 10:55:22,592 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_272028698_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159312144/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159312144/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:22,593 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159312144/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 10:55:22,593 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159312144/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 10:55:22,612 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,618 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159322618"}]},"ts":"1689159322618"} 2023-07-12 10:55:22,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 10:55:22,620 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 10:55:22,622 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-12 10:55:22,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=acb10e44b7103b22c48ccc3fec8732c7, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a4c679eddf4c4684950f66e64899547b, UNASSIGN}] 2023-07-12 10:55:22,626 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=acb10e44b7103b22c48ccc3fec8732c7, UNASSIGN 2023-07-12 10:55:22,628 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a4c679eddf4c4684950f66e64899547b, UNASSIGN 2023-07-12 10:55:22,629 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=acb10e44b7103b22c48ccc3fec8732c7, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:22,629 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159322629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159322629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159322629"}]},"ts":"1689159322629"} 2023-07-12 10:55:22,629 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a4c679eddf4c4684950f66e64899547b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:22,630 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159322629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159322629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159322629"}]},"ts":"1689159322629"} 2023-07-12 10:55:22,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure acb10e44b7103b22c48ccc3fec8732c7, server=jenkins-hbase9.apache.org,36981,1689159209821}] 2023-07-12 10:55:22,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure a4c679eddf4c4684950f66e64899547b, server=jenkins-hbase9.apache.org,46191,1689159209855}] 2023-07-12 10:55:22,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 10:55:22,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a4c679eddf4c4684950f66e64899547b 2023-07-12 10:55:22,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a4c679eddf4c4684950f66e64899547b, disabling compactions & flushes 2023-07-12 10:55:22,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:22,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:22,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. after waiting 0 ms 2023-07-12 10:55:22,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:22,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close acb10e44b7103b22c48ccc3fec8732c7 2023-07-12 10:55:22,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing acb10e44b7103b22c48ccc3fec8732c7, disabling compactions & flushes 2023-07-12 10:55:22,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:22,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:22,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. after waiting 0 ms 2023-07-12 10:55:22,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:22,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:55:22,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:22,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7. 2023-07-12 10:55:22,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for acb10e44b7103b22c48ccc3fec8732c7: 2023-07-12 10:55:22,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:55:22,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:22,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b. 2023-07-12 10:55:22,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a4c679eddf4c4684950f66e64899547b: 2023-07-12 10:55:22,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed acb10e44b7103b22c48ccc3fec8732c7 2023-07-12 10:55:22,819 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=acb10e44b7103b22c48ccc3fec8732c7, regionState=CLOSED 2023-07-12 10:55:22,819 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159322819"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159322819"}]},"ts":"1689159322819"} 2023-07-12 10:55:22,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a4c679eddf4c4684950f66e64899547b 2023-07-12 10:55:22,820 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=a4c679eddf4c4684950f66e64899547b, regionState=CLOSED 2023-07-12 10:55:22,820 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689159322820"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159322820"}]},"ts":"1689159322820"} 2023-07-12 10:55:22,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-12 10:55:22,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure acb10e44b7103b22c48ccc3fec8732c7, server=jenkins-hbase9.apache.org,36981,1689159209821 in 189 msec 2023-07-12 10:55:22,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-12 10:55:22,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure a4c679eddf4c4684950f66e64899547b, server=jenkins-hbase9.apache.org,46191,1689159209855 in 189 msec 2023-07-12 10:55:22,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=acb10e44b7103b22c48ccc3fec8732c7, UNASSIGN in 199 msec 2023-07-12 10:55:22,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-12 10:55:22,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a4c679eddf4c4684950f66e64899547b, UNASSIGN in 200 msec 2023-07-12 10:55:22,828 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159322827"}]},"ts":"1689159322827"} 2023-07-12 10:55:22,829 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 10:55:22,831 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-12 10:55:22,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 220 msec 2023-07-12 10:55:22,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 10:55:22,923 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-12 10:55:22,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,927 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,928 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,930 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,933 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b 2023-07-12 10:55:22,933 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7 2023-07-12 10:55:22,934 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,934 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,934 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,934 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,935 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 10:55:22,935 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 10:55:22,935 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 10:55:22,935 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 10:55:22,936 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/recovered.edits] 2023-07-12 10:55:22,936 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,936 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,936 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:22,936 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,936 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:22,936 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,936 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:22,936 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:22,937 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/recovered.edits] 2023-07-12 10:55:22,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 10:55:22,945 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/cf/6e755da913a847e4953905105c43390f to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/cf/6e755da913a847e4953905105c43390f 2023-07-12 10:55:22,951 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/cf/8e443484faa94e138b10d9de11942728 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/cf/8e443484faa94e138b10d9de11942728 2023-07-12 10:55:22,960 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/recovered.edits/9.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b/recovered.edits/9.seqid 2023-07-12 10:55:22,961 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/a4c679eddf4c4684950f66e64899547b 2023-07-12 10:55:22,962 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/recovered.edits/9.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7/recovered.edits/9.seqid 2023-07-12 10:55:22,963 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testEmptyExportFileSystemState/acb10e44b7103b22c48ccc3fec8732c7 2023-07-12 10:55:22,964 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 10:55:22,964 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 10:55:22,965 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-12 10:55:22,971 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071231ccb6e9112c4d87bd84e72cda7eafca to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071231ccb6e9112c4d87bd84e72cda7eafca 2023-07-12 10:55:22,972 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307127f09179312e44045b568642ac325e32b to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307127f09179312e44045b568642ac325e32b 2023-07-12 10:55:22,973 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 10:55:22,976 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,982 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-12 10:55:22,997 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-12 10:55:22,999 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:22,999 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-12 10:55:22,999 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159322999"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:22,999 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159322999"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:23,005 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 10:55:23,006 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => acb10e44b7103b22c48ccc3fec8732c7, NAME => 'testtb-testEmptyExportFileSystemState,,1689159309968.acb10e44b7103b22c48ccc3fec8732c7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a4c679eddf4c4684950f66e64899547b, NAME => 'testtb-testEmptyExportFileSystemState,1,1689159309968.a4c679eddf4c4684950f66e64899547b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 10:55:23,006 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-12 10:55:23,006 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159323006"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:23,008 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-12 10:55:23,011 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 10:55:23,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 87 msec 2023-07-12 10:55:23,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 10:55:23,039 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-12 10:55:23,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-12 10:55:23,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:23,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-12 10:55:23,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-12 10:55:23,084 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 758) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase9.apache.org/172.31.2.10:35387 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:46334 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase9.apache.org/172.31.2.10:45227 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase9.apache.org/172.31.2.10:42525 from appattempt_1689159217537_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4898 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:35010 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase9.apache.org/172.31.2.10:43761 from appattempt_1689159217537_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1866706096_1 at /127.0.0.1:45810 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:39448 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=723 (was 625) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 182), AvailableMemoryMB=4736 (was 5944) 2023-07-12 10:55:23,084 WARN [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-12 10:55:23,111 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=723, ProcessCount=180, AvailableMemoryMB=4734 2023-07-12 10:55:23,111 WARN [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-12 10:55:23,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 10:55:23,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,119 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 10:55:23,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-12 10:55:23,120 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 10:55:23,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 10:55:23,123 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb 2023-07-12 10:55:23,123 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2 2023-07-12 10:55:23,124 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb empty. 2023-07-12 10:55:23,125 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2 empty. 2023-07-12 10:55:23,125 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb 2023-07-12 10:55:23,125 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2 2023-07-12 10:55:23,125 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 10:55:23,176 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-12 10:55:23,178 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => afc9ee6f735211eb17dd19d81a35f9c2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:55:23,178 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => daebb4b5bf4dec380e53a056cbd429fb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp 2023-07-12 10:55:23,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:23,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing afc9ee6f735211eb17dd19d81a35f9c2, disabling compactions & flushes 2023-07-12 10:55:23,203 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:23,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:23,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. after waiting 0 ms 2023-07-12 10:55:23,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:23,204 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:23,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for afc9ee6f735211eb17dd19d81a35f9c2: 2023-07-12 10:55:23,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:23,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing daebb4b5bf4dec380e53a056cbd429fb, disabling compactions & flushes 2023-07-12 10:55:23,205 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:23,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:23,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. after waiting 0 ms 2023-07-12 10:55:23,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:23,205 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:23,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for daebb4b5bf4dec380e53a056cbd429fb: 2023-07-12 10:55:23,209 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 10:55:23,210 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159323210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159323210"}]},"ts":"1689159323210"} 2023-07-12 10:55:23,211 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159323210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159323210"}]},"ts":"1689159323210"} 2023-07-12 10:55:23,214 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 10:55:23,215 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 10:55:23,215 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159323215"}]},"ts":"1689159323215"} 2023-07-12 10:55:23,216 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-12 10:55:23,220 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-12 10:55:23,221 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 10:55:23,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 10:55:23,222 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 10:55:23,222 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 10:55:23,222 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 10:55:23,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=daebb4b5bf4dec380e53a056cbd429fb, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=afc9ee6f735211eb17dd19d81a35f9c2, ASSIGN}] 2023-07-12 10:55:23,225 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=afc9ee6f735211eb17dd19d81a35f9c2, ASSIGN 2023-07-12 10:55:23,226 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=daebb4b5bf4dec380e53a056cbd429fb, ASSIGN 2023-07-12 10:55:23,227 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=afc9ee6f735211eb17dd19d81a35f9c2, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34083,1689159209755; forceNewPlan=false, retain=false 2023-07-12 10:55:23,227 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=daebb4b5bf4dec380e53a056cbd429fb, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,36981,1689159209821; forceNewPlan=false, retain=false 2023-07-12 10:55:23,377 INFO [jenkins-hbase9:39303] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 10:55:23,380 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=daebb4b5bf4dec380e53a056cbd429fb, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,381 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159323380"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159323380"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159323380"}]},"ts":"1689159323380"} 2023-07-12 10:55:23,381 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=afc9ee6f735211eb17dd19d81a35f9c2, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,381 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159323381"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159323381"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159323381"}]},"ts":"1689159323381"} 2023-07-12 10:55:23,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure daebb4b5bf4dec380e53a056cbd429fb, server=jenkins-hbase9.apache.org,36981,1689159209821}] 2023-07-12 10:55:23,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure afc9ee6f735211eb17dd19d81a35f9c2, server=jenkins-hbase9.apache.org,34083,1689159209755}] 2023-07-12 10:55:23,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 10:55:23,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:23,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => daebb4b5bf4dec380e53a056cbd429fb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 10:55:23,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. service=AccessControlService 2023-07-12 10:55:23,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:55:23,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp daebb4b5bf4dec380e53a056cbd429fb 2023-07-12 10:55:23,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:23,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for daebb4b5bf4dec380e53a056cbd429fb 2023-07-12 10:55:23,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for daebb4b5bf4dec380e53a056cbd429fb 2023-07-12 10:55:23,545 INFO [StoreOpener-daebb4b5bf4dec380e53a056cbd429fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region daebb4b5bf4dec380e53a056cbd429fb 2023-07-12 10:55:23,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:23,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => afc9ee6f735211eb17dd19d81a35f9c2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 10:55:23,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. service=AccessControlService 2023-07-12 10:55:23,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 10:55:23,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp afc9ee6f735211eb17dd19d81a35f9c2 2023-07-12 10:55:23,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 10:55:23,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for afc9ee6f735211eb17dd19d81a35f9c2 2023-07-12 10:55:23,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for afc9ee6f735211eb17dd19d81a35f9c2 2023-07-12 10:55:23,547 INFO [StoreOpener-afc9ee6f735211eb17dd19d81a35f9c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region afc9ee6f735211eb17dd19d81a35f9c2 2023-07-12 10:55:23,548 DEBUG [StoreOpener-daebb4b5bf4dec380e53a056cbd429fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/cf 2023-07-12 10:55:23,548 DEBUG [StoreOpener-daebb4b5bf4dec380e53a056cbd429fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/cf 2023-07-12 10:55:23,548 INFO [StoreOpener-daebb4b5bf4dec380e53a056cbd429fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region daebb4b5bf4dec380e53a056cbd429fb columnFamilyName cf 2023-07-12 10:55:23,550 DEBUG [StoreOpener-afc9ee6f735211eb17dd19d81a35f9c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/cf 2023-07-12 10:55:23,550 DEBUG [StoreOpener-afc9ee6f735211eb17dd19d81a35f9c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/cf 2023-07-12 10:55:23,551 INFO [StoreOpener-daebb4b5bf4dec380e53a056cbd429fb-1] regionserver.HStore(310): Store=daebb4b5bf4dec380e53a056cbd429fb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:55:23,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb 2023-07-12 10:55:23,552 INFO [StoreOpener-afc9ee6f735211eb17dd19d81a35f9c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afc9ee6f735211eb17dd19d81a35f9c2 columnFamilyName cf 2023-07-12 10:55:23,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb 2023-07-12 10:55:23,554 INFO [StoreOpener-afc9ee6f735211eb17dd19d81a35f9c2-1] regionserver.HStore(310): Store=afc9ee6f735211eb17dd19d81a35f9c2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 10:55:23,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2 2023-07-12 10:55:23,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2 2023-07-12 10:55:23,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for daebb4b5bf4dec380e53a056cbd429fb 2023-07-12 10:55:23,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:55:23,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened daebb4b5bf4dec380e53a056cbd429fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63054753, jitterRate=-0.060410961508750916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:55:23,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for daebb4b5bf4dec380e53a056cbd429fb: 2023-07-12 10:55:23,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for afc9ee6f735211eb17dd19d81a35f9c2 2023-07-12 10:55:23,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb., pid=108, masterSystemTime=1689159323535 2023-07-12 10:55:23,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:23,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:23,561 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=daebb4b5bf4dec380e53a056cbd429fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,562 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159323561"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159323561"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159323561"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159323561"}]},"ts":"1689159323561"} 2023-07-12 10:55:23,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-12 10:55:23,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure daebb4b5bf4dec380e53a056cbd429fb, server=jenkins-hbase9.apache.org,36981,1689159209821 in 180 msec 2023-07-12 10:55:23,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=daebb4b5bf4dec380e53a056cbd429fb, ASSIGN in 343 msec 2023-07-12 10:55:23,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 10:55:23,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened afc9ee6f735211eb17dd19d81a35f9c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64324568, jitterRate=-0.041489243507385254}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 10:55:23,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for afc9ee6f735211eb17dd19d81a35f9c2: 2023-07-12 10:55:23,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2., pid=109, masterSystemTime=1689159323536 2023-07-12 10:55:23,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:23,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:23,579 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=afc9ee6f735211eb17dd19d81a35f9c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,579 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159323579"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689159323579"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689159323579"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689159323579"}]},"ts":"1689159323579"} 2023-07-12 10:55:23,584 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-12 10:55:23,584 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure afc9ee6f735211eb17dd19d81a35f9c2, server=jenkins-hbase9.apache.org,34083,1689159209755 in 198 msec 2023-07-12 10:55:23,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-12 10:55:23,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=afc9ee6f735211eb17dd19d81a35f9c2, ASSIGN in 362 msec 2023-07-12 10:55:23,588 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 10:55:23,589 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159323589"}]},"ts":"1689159323589"} 2023-07-12 10:55:23,590 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-12 10:55:23,594 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 10:55:23,594 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-12 10:55:23,596 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 10:55:23,597 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:23,597 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:23,597 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:23,597 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:23,599 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:23,599 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:23,599 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:23,600 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 10:55:23,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 485 msec 2023-07-12 10:55:23,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 10:55:23,724 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-12 10:55:23,727 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,727 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:23,729 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:55:23,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 10:55:23,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159323739 (current time:1689159323739). 2023-07-12 10:55:23,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:55:23,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x3c3ac5ed to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:23,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5148ae9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:23,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:23,753 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:23,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c3ac5ed to 127.0.0.1:53362 2023-07-12 10:55:23,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:23,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x5317b871 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:23,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39e81a53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:23,761 DEBUG [hconnection-0x2d406fbc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:23,764 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:23,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:23,771 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:23,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5317b871 to 127.0.0.1:53362 2023-07-12 10:55:23,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:23,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 10:55:23,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:55:23,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 10:55:23,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 10:55:23,776 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 10:55:23,777 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689159923777 2023-07-12 10:55:23,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 10:55:23,777 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,778 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:55:23,778 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:55:23,779 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 10:55:23,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 10:55:23,779 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-12 10:55:23,780 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 10:55:23,781 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689159923781 2023-07-12 10:55:23,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,792 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 10:55:23,792 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:23,793 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 10:55:23,793 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 10:55:23,793 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,793 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,794 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:23,794 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:23,795 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:23,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:23,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:23,794 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:23,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,795 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,795 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,796 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,796 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:55:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 10:55:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 10:55:23,796 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 10:55:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 10:55:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,796 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 10:55:23,796 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,796 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 10:55:23,796 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 10:55:23,796 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:23,796 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,796 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,796 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 10:55:23,797 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 10:55:23,798 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:23,797 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 10:55:23,798 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 10:55:23,798 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 10:55:23,798 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 10:55:23,798 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 10:55:23,797 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:23,798 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 10:55:23,799 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 10:55:23,799 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 10:55:23,799 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 10:55:23,804 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,804 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:23,805 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,806 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:23,806 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,806 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,806 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:23,806 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,806 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:23,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:23,806 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,806 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:23,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:23,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:23,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 10:55:23,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2176756e[Count = 1] remaining members to acquire global barrier 2023-07-12 10:55:23,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:23,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:23,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:23,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:23,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:23,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:23,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 10:55:23,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2176756e[Count = 0] remaining members to acquire global barrier 2023-07-12 10:55:23,810 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 10:55:23,810 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,811 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,811 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,811 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,811 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 10:55:23,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,811 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 10:55:23,811 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,811 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,46191,1689159209855' in zk 2023-07-12 10:55:23,811 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 10:55:23,812 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 10:55:23,812 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,812 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:55:23,812 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:23,812 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:23,812 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:23,812 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:23,812 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:23,812 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:23,812 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. started... 2023-07-12 10:55:23,812 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. started... 2023-07-12 10:55:23,812 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for daebb4b5bf4dec380e53a056cbd429fb: 2023-07-12 10:55:23,812 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,812 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:23,812 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:55:23,813 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 10:55:23,813 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:23,814 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 10:55:23,819 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for afc9ee6f735211eb17dd19d81a35f9c2: 2023-07-12 10:55:23,819 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,820 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:23,820 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 10:55:23,825 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. completed. 2023-07-12 10:55:23,825 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:23,825 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:23,825 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:23,825 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,825 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 10:55:23,825 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,36981,1689159209821' in zk 2023-07-12 10:55:23,826 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 10:55:23,827 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,827 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:23,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,827 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 10:55:23,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:23,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:23,830 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. completed. 2023-07-12 10:55:23,830 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:23,830 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:23,830 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:23,830 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,830 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 10:55:23,830 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,34083,1689159209755' in zk 2023-07-12 10:55:23,833 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 10:55:23,833 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:23,833 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 10:55:23,834 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:23,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:23,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:23,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:23,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:23,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,36981,1689159209821': 2023-07-12 10:55:23,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 10:55:23,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:23,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:23,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:23,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:23,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,34083,1689159209755': 2023-07-12 10:55:23,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 10:55:23,840 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 10:55:23,840 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:55:23,840 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:55:23,840 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,840 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:55:23,842 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,842 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,843 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:23,843 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,842 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:23,842 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:23,843 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:23,843 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:23,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:23,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:23,844 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:23,844 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,846 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:23,846 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:23,846 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:23,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,849 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:23,849 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:23,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:23,851 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:23,850 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:23,850 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:23,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:23,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 10:55:23,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:23,851 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:23,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:23,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:23,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 10:55:23,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,878 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:23,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 10:55:23,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:23,879 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:55:23,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 10:55:23,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,909 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:23,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689159323777Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689159323861 (+84 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689159323861Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689159323861Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689159323870 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689159323883 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689159323908 (+25 ms) 2023-07-12 10:55:23,912 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 10:55:23,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 134 msec 2023-07-12 10:55:24,079 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:24,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 10:55:24,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:55:24,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36981] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:55:24,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34083] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 10:55:24,102 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,102 DEBUG [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:24,102 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 10:55:24,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 10:55:24,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689159324122 (current time:1689159324122). 2023-07-12 10:55:24,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 10:55:24,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x5887f774 to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:24,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76144e57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:24,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:24,161 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:24,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5887f774 to 127.0.0.1:53362 2023-07-12 10:55:24,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:24,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(139): Connect 0x4f7a133a to 127.0.0.1:53362 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 10:55:24,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@282171f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 10:55:24,196 DEBUG [hconnection-0x7c13e453-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:24,202 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:24,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 10:55:24,214 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 10:55:24,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f7a133a to 127.0.0.1:53362 2023-07-12 10:55:24,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:55:24,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 10:55:24,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 10:55:24,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 10:55:24,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 10:55:24,225 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 10:55:24,226 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689159924226 2023-07-12 10:55:24,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 10:55:24,226 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,228 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 10:55:24,228 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 10:55:24,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 10:55:24,230 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 10:55:24,232 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-12 10:55:24,234 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 10:55:24,236 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689159924236 2023-07-12 10:55:24,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,262 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 10:55:24,263 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:24,264 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 10:55:24,264 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 10:55:24,265 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,265 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,266 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:24,266 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:24,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:24,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:24,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:24,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:24,267 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,267 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:24,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:24,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:24,267 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,268 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,268 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,268 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 10:55:24,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 10:55:24,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,270 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 10:55:24,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 10:55:24,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,271 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 10:55:24,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 10:55:24,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,271 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 10:55:24,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,272 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 10:55:24,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,272 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:24,272 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 10:55:24,272 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:24,275 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,275 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 10:55:24,275 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 10:55:24,275 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 10:55:24,275 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 10:55:24,276 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 10:55:24,276 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 10:55:24,276 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46191,1689159209855' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 10:55:24,275 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 10:55:24,276 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 10:55:24,276 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 10:55:24,276 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 10:55:24,281 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,282 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,282 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,282 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:24,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:24,282 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:24,282 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,282 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:24,283 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,283 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:24,283 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,283 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 10:55:24,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:24,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:24,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:24,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,36981,1689159209821' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 10:55:24,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21da064b[Count = 1] remaining members to acquire global barrier 2023-07-12 10:55:24,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:24,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:24,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:24,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:24,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:24,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34083,1689159209755' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 10:55:24,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21da064b[Count = 0] remaining members to acquire global barrier 2023-07-12 10:55:24,288 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 10:55:24,288 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,293 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,293 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,293 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,293 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 10:55:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,293 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,293 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 10:55:24,293 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:24,294 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:24,293 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 10:55:24,294 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. started... 2023-07-12 10:55:24,294 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:24,294 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 10:55:24,294 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,294 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 10:55:24,294 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 10:55:24,294 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2745): Flushing afc9ee6f735211eb17dd19d81a35f9c2 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 10:55:24,294 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,46191,1689159209855' in zk 2023-07-12 10:55:24,294 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:24,294 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 10:55:24,294 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. started... 2023-07-12 10:55:24,294 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegion(2745): Flushing daebb4b5bf4dec380e53a056cbd429fb 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 10:55:24,296 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 10:55:24,296 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:24,296 DEBUG [member: 'jenkins-hbase9.apache.org,46191,1689159209855' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 10:55:24,325 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712a6b54d148059468c8bd4064d66d4a88d to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712a6b54d148059468c8bd4064d66d4a88d 2023-07-12 10:55:24,328 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:24,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 10:55:24,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:24,329 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712159028c228b844f18163d5a1944cf299 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712159028c228b844f18163d5a1944cf299 2023-07-12 10:55:24,330 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 10:55:24,333 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/.tmp/cf/798fb50fe8ff459d930d9f4f49665212 2023-07-12 10:55:24,338 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/.tmp/cf/798fb50fe8ff459d930d9f4f49665212 as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/cf/798fb50fe8ff459d930d9f4f49665212 2023-07-12 10:55:24,339 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/.tmp/cf/f12cf2a3313f4a8fbbd4b39a67941df1 2023-07-12 10:55:24,344 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/cf/798fb50fe8ff459d930d9f4f49665212, entries=3, sequenceid=6, filesize=5.4 K 2023-07-12 10:55:24,345 INFO [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for daebb4b5bf4dec380e53a056cbd429fb in 51ms, sequenceid=6, compaction requested=false 2023-07-12 10:55:24,345 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 10:55:24,345 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for daebb4b5bf4dec380e53a056cbd429fb: 2023-07-12 10:55:24,346 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,346 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/.tmp/cf/f12cf2a3313f4a8fbbd4b39a67941df1 as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/cf/f12cf2a3313f4a8fbbd4b39a67941df1 2023-07-12 10:55:24,346 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:24,346 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/cf/798fb50fe8ff459d930d9f4f49665212] hfiles 2023-07-12 10:55:24,346 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/cf/798fb50fe8ff459d930d9f4f49665212 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,356 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/cf/f12cf2a3313f4a8fbbd4b39a67941df1, entries=47, sequenceid=6, filesize=13.3 K 2023-07-12 10:55:24,357 INFO [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for afc9ee6f735211eb17dd19d81a35f9c2 in 63ms, sequenceid=6, compaction requested=false 2023-07-12 10:55:24,359 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for afc9ee6f735211eb17dd19d81a35f9c2: 2023-07-12 10:55:24,359 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,359 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 10:55:24,359 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/cf/f12cf2a3313f4a8fbbd4b39a67941df1] hfiles 2023-07-12 10:55:24,359 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/cf/f12cf2a3313f4a8fbbd4b39a67941df1 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,386 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. completed. 2023-07-12 10:55:24,386 DEBUG [rs(jenkins-hbase9.apache.org,34083,1689159209755)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:24,387 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:24,387 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:24,387 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,387 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 10:55:24,387 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,34083,1689159209755' in zk 2023-07-12 10:55:24,388 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,388 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 10:55:24,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:24,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:24,389 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:24,389 DEBUG [member: 'jenkins-hbase9.apache.org,34083,1689159209755' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 10:55:24,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:24,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:24,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:24,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:24,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:24,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,34083,1689159209755': 2023-07-12 10:55:24,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34083,1689159209755' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 10:55:24,530 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:24,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 10:55:24,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:24,531 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 10:55:24,762 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. completed. 2023-07-12 10:55:24,762 DEBUG [rs(jenkins-hbase9.apache.org,36981,1689159209821)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:24,762 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 10:55:24,762 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 10:55:24,762 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,762 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 10:55:24,762 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,36981,1689159209821' in zk 2023-07-12 10:55:24,765 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,765 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 10:55:24,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:24,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:24,765 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:24,765 DEBUG [member: 'jenkins-hbase9.apache.org,36981,1689159209821' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 10:55:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:24,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:24,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:24,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,36981,1689159209821': 2023-07-12 10:55:24,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,36981,1689159209821' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 10:55:24,770 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 10:55:24,770 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 10:55:24,770 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 10:55:24,770 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,770 INFO [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 10:55:24,772 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,772 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,772 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 10:55:24,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 10:55:24,772 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,772 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:24,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 10:55:24,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,772 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:24,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,772 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:24,772 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:24,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:24,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:24,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:24,773 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:24,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:24,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 10:55:24,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,773 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:24,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:24,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 10:55:24,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,775 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,775 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,776 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:24,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:24,778 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:24,778 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,779 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,779 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,779 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:24,779 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:24,779 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:24,779 DEBUG [(jenkins-hbase9.apache.org,39303,1689159208284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 10:55:24,779 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 10:55:24,779 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,779 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:24,779 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:55:24,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:24,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:24,779 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:24,780 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,779 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:24,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 10:55:24,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:24,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 10:55:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 10:55:24,779 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 10:55:24,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:24,781 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:24,781 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:24,782 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,782 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 10:55:24,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 10:55:24,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712159028c228b844f18163d5a1944cf299, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712a6b54d148059468c8bd4064d66d4a88d] mob files 2023-07-12 10:55:24,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712159028c228b844f18163d5a1944cf299 2023-07-12 10:55:24,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712a6b54d148059468c8bd4064d66d4a88d 2023-07-12 10:55:24,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,832 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:24,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 10:55:24,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 10:55:24,833 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 10:55:24,851 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 10:55:24,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,852 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:24,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689159324226Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689159324789 (+563 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689159324789Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689159324789Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689159324793 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689159324805 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689159324851 (+46 ms) 2023-07-12 10:55:24,855 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 10:55:24,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 627 msec 2023-07-12 10:55:25,333 DEBUG [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 10:55:25,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 10:55:25,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 10:55:25,334 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159325334 2023-07-12 10:55:25,335 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44111, tgtDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159325334, rawTgtDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159325334, srcFsUri=hdfs://localhost:44111, srcDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:55:25,358 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648 2023-07-12 10:55:25,358 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-430871149_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159325334, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159325334/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:25,358 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44111, inputRoot=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648, snapshotDir=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-12 10:55:25,372 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159325334/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:25,411 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:25,411 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:25,411 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:25,412 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:25,412 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:25,412 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:25,413 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:25,499 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/hadoop-4306056192540140456.jar 2023-07-12 10:55:25,500 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:25,501 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:25,501 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:25,502 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:25,502 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:25,503 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 10:55:25,503 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 10:55:25,503 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 10:55:25,504 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 10:55:25,504 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 10:55:25,505 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 10:55:25,505 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 10:55:25,506 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 10:55:25,506 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 10:55:25,506 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 10:55:25,507 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 10:55:25,507 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:25,508 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:25,508 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:55:25,509 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:25,509 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 10:55:25,510 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:55:25,510 DEBUG [Listener at jenkins-hbase9.apache.org/45227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 10:55:26,246 WARN [Listener at jenkins-hbase9.apache.org/45227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 10:55:26,248 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-12 10:55:26,250 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-12 10:55:27,506 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:55:27,506 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 10:55:27,514 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0006_000001 (auth:SIMPLE) 2023-07-12 10:55:27,547 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0007_000001 (auth:SIMPLE) 2023-07-12 10:55:28,407 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:55:32,379 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0007_000001 (auth:SIMPLE) 2023-07-12 10:55:34,683 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0007_000001 (auth:SIMPLE) 2023-07-12 10:55:39,435 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0007_000001 (auth:SIMPLE) 2023-07-12 10:55:40,697 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 10:55:40,698 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 10:55:40,727 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:40,728 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 10:55:40,728 INFO [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 10:55:40,728 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_272028698_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:40,734 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 10:55:40,734 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 10:55:40,734 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_272028698_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159325334/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159325334/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:40,735 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159325334/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 10:55:40,735 DEBUG [Listener at jenkins-hbase9.apache.org/45227] snapshot.TestExportSnapshot(367): hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/export-test/export-1689159325334/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 10:55:40,750 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:40,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:40,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:40,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 10:55:40,758 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159340758"}]},"ts":"1689159340758"} 2023-07-12 10:55:40,759 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-12 10:55:40,761 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-12 10:55:40,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=daebb4b5bf4dec380e53a056cbd429fb, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=afc9ee6f735211eb17dd19d81a35f9c2, UNASSIGN}] 2023-07-12 10:55:40,765 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=daebb4b5bf4dec380e53a056cbd429fb, UNASSIGN 2023-07-12 10:55:40,765 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=afc9ee6f735211eb17dd19d81a35f9c2, UNASSIGN 2023-07-12 10:55:40,766 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=daebb4b5bf4dec380e53a056cbd429fb, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:55:40,766 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159340766"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159340766"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159340766"}]},"ts":"1689159340766"} 2023-07-12 10:55:40,766 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=afc9ee6f735211eb17dd19d81a35f9c2, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:55:40,767 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159340766"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689159340766"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689159340766"}]},"ts":"1689159340766"} 2023-07-12 10:55:40,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure daebb4b5bf4dec380e53a056cbd429fb, server=jenkins-hbase9.apache.org,36981,1689159209821}] 2023-07-12 10:55:40,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure afc9ee6f735211eb17dd19d81a35f9c2, server=jenkins-hbase9.apache.org,34083,1689159209755}] 2023-07-12 10:55:40,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 10:55:40,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close daebb4b5bf4dec380e53a056cbd429fb 2023-07-12 10:55:40,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing daebb4b5bf4dec380e53a056cbd429fb, disabling compactions & flushes 2023-07-12 10:55:40,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:40,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:40,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. after waiting 0 ms 2023-07-12 10:55:40,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:40,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close afc9ee6f735211eb17dd19d81a35f9c2 2023-07-12 10:55:40,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing afc9ee6f735211eb17dd19d81a35f9c2, disabling compactions & flushes 2023-07-12 10:55:40,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:40,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:40,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. after waiting 0 ms 2023-07-12 10:55:40,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:40,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:55:40,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:40,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb. 2023-07-12 10:55:40,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for daebb4b5bf4dec380e53a056cbd429fb: 2023-07-12 10:55:40,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed daebb4b5bf4dec380e53a056cbd429fb 2023-07-12 10:55:40,991 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=daebb4b5bf4dec380e53a056cbd429fb, regionState=CLOSED 2023-07-12 10:55:40,991 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159340990"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159340990"}]},"ts":"1689159340990"} 2023-07-12 10:55:40,997 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-12 10:55:40,997 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure daebb4b5bf4dec380e53a056cbd429fb, server=jenkins-hbase9.apache.org,36981,1689159209821 in 227 msec 2023-07-12 10:55:40,998 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=daebb4b5bf4dec380e53a056cbd429fb, UNASSIGN in 235 msec 2023-07-12 10:55:41,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:55:41,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:55:41,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2. 2023-07-12 10:55:41,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for afc9ee6f735211eb17dd19d81a35f9c2: 2023-07-12 10:55:41,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed afc9ee6f735211eb17dd19d81a35f9c2 2023-07-12 10:55:41,010 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=afc9ee6f735211eb17dd19d81a35f9c2, regionState=CLOSED 2023-07-12 10:55:41,010 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689159341010"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689159341010"}]},"ts":"1689159341010"} 2023-07-12 10:55:41,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-12 10:55:41,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure afc9ee6f735211eb17dd19d81a35f9c2, server=jenkins-hbase9.apache.org,34083,1689159209755 in 243 msec 2023-07-12 10:55:41,014 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-12 10:55:41,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=afc9ee6f735211eb17dd19d81a35f9c2, UNASSIGN in 251 msec 2023-07-12 10:55:41,015 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689159341015"}]},"ts":"1689159341015"} 2023-07-12 10:55:41,017 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-12 10:55:41,018 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-12 10:55:41,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 268 msec 2023-07-12 10:55:41,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 10:55:41,059 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-12 10:55:41,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,064 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,066 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46191] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,067 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,071 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,071 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,071 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,072 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,072 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 10:55:41,072 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 10:55:41,073 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 10:55:41,073 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb 2023-07-12 10:55:41,073 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,073 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:41,073 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:41,073 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,074 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2 2023-07-12 10:55:41,074 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:41,074 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,074 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 10:55:41,074 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-12 10:55:41,074 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 10:55:41,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 10:55:41,076 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/recovered.edits] 2023-07-12 10:55:41,077 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/cf, FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/recovered.edits] 2023-07-12 10:55:41,089 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/cf/f12cf2a3313f4a8fbbd4b39a67941df1 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/cf/f12cf2a3313f4a8fbbd4b39a67941df1 2023-07-12 10:55:41,090 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/cf/798fb50fe8ff459d930d9f4f49665212 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/cf/798fb50fe8ff459d930d9f4f49665212 2023-07-12 10:55:41,095 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/recovered.edits/9.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2/recovered.edits/9.seqid 2023-07-12 10:55:41,095 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/afc9ee6f735211eb17dd19d81a35f9c2 2023-07-12 10:55:41,096 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/recovered.edits/9.seqid to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb/recovered.edits/9.seqid 2023-07-12 10:55:41,097 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/daebb4b5bf4dec380e53a056cbd429fb 2023-07-12 10:55:41,097 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 10:55:41,097 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 10:55:41,098 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-12 10:55:41,105 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712159028c228b844f18163d5a1944cf299 to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712159028c228b844f18163d5a1944cf299 2023-07-12 10:55:41,107 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712a6b54d148059468c8bd4064d66d4a88d to hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712a6b54d148059468c8bd4064d66d4a88d 2023-07-12 10:55:41,107 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 10:55:41,110 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,112 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-12 10:55:41,117 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-12 10:55:41,118 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,118 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-12 10:55:41,118 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159341118"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:41,119 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689159341118"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:41,123 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 10:55:41,123 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => daebb4b5bf4dec380e53a056cbd429fb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689159323113.daebb4b5bf4dec380e53a056cbd429fb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => afc9ee6f735211eb17dd19d81a35f9c2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689159323113.afc9ee6f735211eb17dd19d81a35f9c2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 10:55:41,123 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-12 10:55:41,124 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689159341123"}]},"ts":"9223372036854775807"} 2023-07-12 10:55:41,125 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-12 10:55:41,127 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 67 msec 2023-07-12 10:55:41,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 10:55:41,183 INFO [Listener at jenkins-hbase9.apache.org/45227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-12 10:55:41,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 10:55:41,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 10:55:41,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39303] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 10:55:41,253 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 760) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1811110140_1 at /127.0.0.1:43546 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:50656 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:43584 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5536 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272028698_17 at /127.0.0.1:59296 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d4dea46-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1477432893) connection to jenkins-hbase9.apache.org/172.31.2.10:34125 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=644 (was 723), ProcessCount=183 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=4556 (was 4734) 2023-07-12 10:55:41,253 WARN [Listener at jenkins-hbase9.apache.org/45227] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-12 10:55:41,253 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-12 10:55:41,272 INFO [Listener at jenkins-hbase9.apache.org/45227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-12 10:55:45,619 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689159217537_0007_000001 (auth:SIMPLE) 2023-07-12 10:55:46,562 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 10:55:55,397 INFO [Listener at jenkins-hbase9.apache.org/45227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-12 10:56:09,515 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 10:56:09,516 INFO [Listener at jenkins-hbase9.apache.org/45227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-12 10:56:09,631 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-12 10:56:09,642 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-12 10:56:09,643 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 10:56:09,654 INFO [Listener at jenkins-hbase9.apache.org/45227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-12 10:56:09,758 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 10:56:09,758 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-12 10:56:09,758 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 10:56:09,758 INFO [Listener at jenkins-hbase9.apache.org/45227] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 10:56:09,758 DEBUG [Listener at jenkins-hbase9.apache.org/45227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x416d673c to 127.0.0.1:53362 2023-07-12 10:56:09,758 DEBUG [Listener at jenkins-hbase9.apache.org/45227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:09,758 DEBUG [Listener at jenkins-hbase9.apache.org/45227] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 10:56:09,758 DEBUG [Listener at jenkins-hbase9.apache.org/45227] util.JVMClusterUtil(257): Found active master hash=1655812806, stopped=false 2023-07-12 10:56:09,759 DEBUG [Listener at jenkins-hbase9.apache.org/45227] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:09,759 DEBUG [Listener at jenkins-hbase9.apache.org/45227] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 10:56:09,759 INFO [Listener at jenkins-hbase9.apache.org/45227] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,39303,1689159208284 2023-07-12 10:56:09,761 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 10:56:09,761 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 10:56:09,761 INFO [Listener at jenkins-hbase9.apache.org/45227] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 10:56:09,761 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 10:56:09,761 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:56:09,761 DEBUG [Listener at jenkins-hbase9.apache.org/45227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1234113f to 127.0.0.1:53362 2023-07-12 10:56:09,761 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 10:56:09,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:56:09,761 DEBUG [Listener at jenkins-hbase9.apache.org/45227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:09,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:56:09,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:56:09,762 INFO [Listener at jenkins-hbase9.apache.org/45227] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,34083,1689159209755' ***** 2023-07-12 10:56:09,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 10:56:09,762 DEBUG [Listener at jenkins-hbase9.apache.org/45227] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:09,762 INFO [Listener at jenkins-hbase9.apache.org/45227] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 10:56:09,762 INFO [Listener at jenkins-hbase9.apache.org/45227] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,36981,1689159209821' ***** 2023-07-12 10:56:09,763 DEBUG [Listener at jenkins-hbase9.apache.org/45227] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:09,763 INFO [Listener at jenkins-hbase9.apache.org/45227] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 10:56:09,763 INFO [RS:0;jenkins-hbase9:34083] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 10:56:09,763 INFO [Listener at jenkins-hbase9.apache.org/45227] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,46191,1689159209855' ***** 2023-07-12 10:56:09,763 DEBUG [Listener at jenkins-hbase9.apache.org/45227] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:09,763 INFO [RS:0;jenkins-hbase9:34083] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 10:56:09,763 INFO [Listener at jenkins-hbase9.apache.org/45227] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 10:56:09,763 INFO [RS:1;jenkins-hbase9:36981] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 10:56:09,763 INFO [RS:0;jenkins-hbase9:34083] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 10:56:09,763 INFO [RS:1;jenkins-hbase9:36981] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 10:56:09,763 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 10:56:09,763 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 10:56:09,763 INFO [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:56:09,763 INFO [RS:1;jenkins-hbase9:36981] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 10:56:09,763 INFO [RS:2;jenkins-hbase9:46191] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 10:56:09,763 DEBUG [RS:0;jenkins-hbase9:34083] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09dfd553 to 127.0.0.1:53362 2023-07-12 10:56:09,764 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 10:56:09,764 INFO [RS:2;jenkins-hbase9:46191] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 10:56:09,764 INFO [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(3305): Received CLOSE for 8782dc4ac9c7873d9ae66891c63ddb6f 2023-07-12 10:56:09,764 DEBUG [RS:0;jenkins-hbase9:34083] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:09,764 INFO [RS:2;jenkins-hbase9:46191] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 10:56:09,766 INFO [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,34083,1689159209755; all regions closed. 2023-07-12 10:56:09,766 INFO [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:56:09,766 INFO [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(3305): Received CLOSE for afa78ab2e1f54be524e7eda1c8b899f9 2023-07-12 10:56:09,767 DEBUG [RS:1;jenkins-hbase9:36981] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x388187e2 to 127.0.0.1:53362 2023-07-12 10:56:09,767 INFO [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:56:09,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8782dc4ac9c7873d9ae66891c63ddb6f, disabling compactions & flushes 2023-07-12 10:56:09,768 DEBUG [RS:2;jenkins-hbase9:46191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x351fe54d to 127.0.0.1:53362 2023-07-12 10:56:09,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing afa78ab2e1f54be524e7eda1c8b899f9, disabling compactions & flushes 2023-07-12 10:56:09,767 DEBUG [RS:1;jenkins-hbase9:36981] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:09,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. 2023-07-12 10:56:09,769 INFO [RS:1;jenkins-hbase9:36981] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 10:56:09,768 DEBUG [RS:2;jenkins-hbase9:46191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:09,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. 2023-07-12 10:56:09,769 INFO [RS:1;jenkins-hbase9:36981] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 10:56:09,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. 2023-07-12 10:56:09,769 INFO [RS:1;jenkins-hbase9:36981] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 10:56:09,769 INFO [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 10:56:09,770 INFO [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 10:56:09,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. 2023-07-12 10:56:09,770 DEBUG [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(1478): Online Regions={afa78ab2e1f54be524e7eda1c8b899f9=hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9.} 2023-07-12 10:56:09,770 INFO [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-12 10:56:09,770 DEBUG [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 8782dc4ac9c7873d9ae66891c63ddb6f=hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f.} 2023-07-12 10:56:09,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. after waiting 0 ms 2023-07-12 10:56:09,770 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 10:56:09,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. after waiting 0 ms 2023-07-12 10:56:09,771 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 10:56:09,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. 2023-07-12 10:56:09,771 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 10:56:09,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 8782dc4ac9c7873d9ae66891c63ddb6f 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 10:56:09,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. 2023-07-12 10:56:09,771 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 10:56:09,771 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 10:56:09,771 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 10:56:09,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing afa78ab2e1f54be524e7eda1c8b899f9 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-12 10:56:09,771 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-12 10:56:09,771 DEBUG [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(1504): Waiting on afa78ab2e1f54be524e7eda1c8b899f9 2023-07-12 10:56:09,771 DEBUG [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(1504): Waiting on 1588230740, 8782dc4ac9c7873d9ae66891c63ddb6f 2023-07-12 10:56:09,789 DEBUG [RS:0;jenkins-hbase9:34083] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/oldWALs 2023-07-12 10:56:09,789 INFO [RS:0;jenkins-hbase9:34083] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C34083%2C1689159209755:(num 1689159212025) 2023-07-12 10:56:09,789 DEBUG [RS:0;jenkins-hbase9:34083] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:09,789 INFO [RS:0;jenkins-hbase9:34083] regionserver.LeaseManager(133): Closed leases 2023-07-12 10:56:09,789 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 10:56:09,790 INFO [RS:0;jenkins-hbase9:34083] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 10:56:09,790 INFO [RS:0;jenkins-hbase9:34083] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 10:56:09,790 INFO [RS:0;jenkins-hbase9:34083] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 10:56:09,790 INFO [RS:0;jenkins-hbase9:34083] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 10:56:09,791 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 10:56:09,798 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 10:56:09,798 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 10:56:09,806 INFO [RS:0;jenkins-hbase9:34083] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:34083 2023-07-12 10:56:09,810 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/.tmp/info/f558627f86354228af4f8008dcade8d4 2023-07-12 10:56:09,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/acl/afa78ab2e1f54be524e7eda1c8b899f9/.tmp/l/7df6c354ddce42b29aff9adb3ed1b02c 2023-07-12 10:56:09,816 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:56:09,816 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:56:09,816 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:56:09,816 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:56:09,816 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:56:09,816 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,34083,1689159209755 2023-07-12 10:56:09,816 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:56:09,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/namespace/8782dc4ac9c7873d9ae66891c63ddb6f/.tmp/info/a8478211e6874a5184e735bfbfa6c3f4 2023-07-12 10:56:09,817 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f558627f86354228af4f8008dcade8d4 2023-07-12 10:56:09,817 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,34083,1689159209755] 2023-07-12 10:56:09,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7df6c354ddce42b29aff9adb3ed1b02c 2023-07-12 10:56:09,818 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,34083,1689159209755; numProcessing=1 2023-07-12 10:56:09,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/acl/afa78ab2e1f54be524e7eda1c8b899f9/.tmp/l/7df6c354ddce42b29aff9adb3ed1b02c as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/acl/afa78ab2e1f54be524e7eda1c8b899f9/l/7df6c354ddce42b29aff9adb3ed1b02c 2023-07-12 10:56:09,820 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,34083,1689159209755 already deleted, retry=false 2023-07-12 10:56:09,820 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,34083,1689159209755 expired; onlineServers=2 2023-07-12 10:56:09,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/namespace/8782dc4ac9c7873d9ae66891c63ddb6f/.tmp/info/a8478211e6874a5184e735bfbfa6c3f4 as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/namespace/8782dc4ac9c7873d9ae66891c63ddb6f/info/a8478211e6874a5184e735bfbfa6c3f4 2023-07-12 10:56:09,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7df6c354ddce42b29aff9adb3ed1b02c 2023-07-12 10:56:09,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/acl/afa78ab2e1f54be524e7eda1c8b899f9/l/7df6c354ddce42b29aff9adb3ed1b02c, entries=7, sequenceid=18, filesize=5.2 K 2023-07-12 10:56:09,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for afa78ab2e1f54be524e7eda1c8b899f9 in 56ms, sequenceid=18, compaction requested=false 2023-07-12 10:56:09,828 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 10:56:09,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/namespace/8782dc4ac9c7873d9ae66891c63ddb6f/info/a8478211e6874a5184e735bfbfa6c3f4, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 10:56:09,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8782dc4ac9c7873d9ae66891c63ddb6f in 71ms, sequenceid=6, compaction requested=false 2023-07-12 10:56:09,846 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/.tmp/rep_barrier/a88d99dd427e482ead16504c846d7b39 2023-07-12 10:56:09,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/acl/afa78ab2e1f54be524e7eda1c8b899f9/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-12 10:56:09,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/namespace/8782dc4ac9c7873d9ae66891c63ddb6f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 10:56:09,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:09,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:09,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. 2023-07-12 10:56:09,854 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a88d99dd427e482ead16504c846d7b39 2023-07-12 10:56:09,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. 2023-07-12 10:56:09,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8782dc4ac9c7873d9ae66891c63ddb6f: 2023-07-12 10:56:09,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for afa78ab2e1f54be524e7eda1c8b899f9: 2023-07-12 10:56:09,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689159212691.8782dc4ac9c7873d9ae66891c63ddb6f. 2023-07-12 10:56:09,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689159213463.afa78ab2e1f54be524e7eda1c8b899f9. 2023-07-12 10:56:09,867 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/.tmp/table/fe6124bf7c264b3cba859a20a6094bb7 2023-07-12 10:56:09,871 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe6124bf7c264b3cba859a20a6094bb7 2023-07-12 10:56:09,872 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/.tmp/info/f558627f86354228af4f8008dcade8d4 as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/info/f558627f86354228af4f8008dcade8d4 2023-07-12 10:56:09,876 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f558627f86354228af4f8008dcade8d4 2023-07-12 10:56:09,876 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/info/f558627f86354228af4f8008dcade8d4, entries=48, sequenceid=131, filesize=10.3 K 2023-07-12 10:56:09,877 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/.tmp/rep_barrier/a88d99dd427e482ead16504c846d7b39 as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/rep_barrier/a88d99dd427e482ead16504c846d7b39 2023-07-12 10:56:09,882 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a88d99dd427e482ead16504c846d7b39 2023-07-12 10:56:09,882 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/rep_barrier/a88d99dd427e482ead16504c846d7b39, entries=13, sequenceid=131, filesize=6.4 K 2023-07-12 10:56:09,883 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/.tmp/table/fe6124bf7c264b3cba859a20a6094bb7 as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/table/fe6124bf7c264b3cba859a20a6094bb7 2023-07-12 10:56:09,888 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fe6124bf7c264b3cba859a20a6094bb7 2023-07-12 10:56:09,888 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/table/fe6124bf7c264b3cba859a20a6094bb7, entries=24, sequenceid=131, filesize=6.9 K 2023-07-12 10:56:09,889 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 118ms, sequenceid=131, compaction requested=false 2023-07-12 10:56:09,896 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 10:56:09,896 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 10:56:09,898 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-12 10:56:09,899 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 10:56:09,899 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 10:56:09,899 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 10:56:09,899 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 10:56:09,899 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 10:56:09,919 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:09,919 INFO [RS:0;jenkins-hbase9:34083] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,34083,1689159209755; zookeeper connection closed. 2023-07-12 10:56:09,919 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:34083-0x101591ccd770001, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:09,919 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@36efee05] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@36efee05 2023-07-12 10:56:09,971 INFO [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,46191,1689159209855; all regions closed. 2023-07-12 10:56:09,971 INFO [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,36981,1689159209821; all regions closed. 2023-07-12 10:56:09,979 DEBUG [RS:2;jenkins-hbase9:46191] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/oldWALs 2023-07-12 10:56:09,979 INFO [RS:2;jenkins-hbase9:46191] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C46191%2C1689159209855:(num 1689159212025) 2023-07-12 10:56:09,979 DEBUG [RS:2;jenkins-hbase9:46191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:09,979 INFO [RS:2;jenkins-hbase9:46191] regionserver.LeaseManager(133): Closed leases 2023-07-12 10:56:09,980 INFO [RS:2;jenkins-hbase9:46191] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 10:56:09,980 INFO [RS:2;jenkins-hbase9:46191] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 10:56:09,980 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 10:56:09,980 INFO [RS:2;jenkins-hbase9:46191] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 10:56:09,980 INFO [RS:2;jenkins-hbase9:46191] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 10:56:09,982 INFO [RS:2;jenkins-hbase9:46191] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:46191 2023-07-12 10:56:09,983 DEBUG [RS:1;jenkins-hbase9:36981] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/oldWALs 2023-07-12 10:56:09,983 INFO [RS:1;jenkins-hbase9:36981] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C36981%2C1689159209821.meta:.meta(num 1689159212324) 2023-07-12 10:56:09,983 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:56:09,983 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:56:09,983 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,46191,1689159209855 2023-07-12 10:56:09,985 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,46191,1689159209855] 2023-07-12 10:56:09,985 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,46191,1689159209855; numProcessing=2 2023-07-12 10:56:09,987 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,46191,1689159209855 already deleted, retry=false 2023-07-12 10:56:09,987 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,46191,1689159209855 expired; onlineServers=1 2023-07-12 10:56:09,988 DEBUG [RS:1;jenkins-hbase9:36981] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/oldWALs 2023-07-12 10:56:09,988 INFO [RS:1;jenkins-hbase9:36981] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C36981%2C1689159209821:(num 1689159212017) 2023-07-12 10:56:09,988 DEBUG [RS:1;jenkins-hbase9:36981] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:09,988 INFO [RS:1;jenkins-hbase9:36981] regionserver.LeaseManager(133): Closed leases 2023-07-12 10:56:09,988 INFO [RS:1;jenkins-hbase9:36981] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 10:56:09,988 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 10:56:09,989 INFO [RS:1;jenkins-hbase9:36981] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:36981 2023-07-12 10:56:09,991 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,36981,1689159209821 2023-07-12 10:56:09,991 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 10:56:09,992 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,36981,1689159209821] 2023-07-12 10:56:09,993 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,36981,1689159209821; numProcessing=3 2023-07-12 10:56:09,994 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,36981,1689159209821 already deleted, retry=false 2023-07-12 10:56:09,994 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,36981,1689159209821 expired; onlineServers=0 2023-07-12 10:56:09,994 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,39303,1689159208284' ***** 2023-07-12 10:56:09,994 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 10:56:09,994 DEBUG [M:0;jenkins-hbase9:39303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@238cb8fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-12 10:56:09,994 INFO [M:0;jenkins-hbase9:39303] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,39303,1689159208284 2023-07-12 10:56:09,994 INFO [M:0;jenkins-hbase9:39303] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,39303,1689159208284; all regions closed. 2023-07-12 10:56:09,994 DEBUG [M:0;jenkins-hbase9:39303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 10:56:09,995 DEBUG [M:0;jenkins-hbase9:39303] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 10:56:09,995 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 10:56:09,995 DEBUG [M:0;jenkins-hbase9:39303] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 10:56:09,995 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689159211560] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689159211560,5,FailOnTimeoutGroup] 2023-07-12 10:56:09,995 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689159211561] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689159211561,5,FailOnTimeoutGroup] 2023-07-12 10:56:09,995 INFO [M:0;jenkins-hbase9:39303] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 10:56:09,995 INFO [M:0;jenkins-hbase9:39303] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 10:56:09,995 INFO [M:0;jenkins-hbase9:39303] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-12 10:56:09,995 DEBUG [M:0;jenkins-hbase9:39303] master.HMaster(1512): Stopping service threads 2023-07-12 10:56:09,995 INFO [M:0;jenkins-hbase9:39303] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 10:56:09,996 ERROR [M:0;jenkins-hbase9:39303] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-12 10:56:09,996 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 10:56:09,996 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 10:56:09,996 INFO [M:0;jenkins-hbase9:39303] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 10:56:09,996 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 10:56:09,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 10:56:09,997 DEBUG [M:0;jenkins-hbase9:39303] zookeeper.ZKUtil(398): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 10:56:09,997 WARN [M:0;jenkins-hbase9:39303] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 10:56:09,997 INFO [M:0;jenkins-hbase9:39303] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 10:56:09,997 INFO [M:0;jenkins-hbase9:39303] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 10:56:09,997 DEBUG [M:0;jenkins-hbase9:39303] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 10:56:09,997 INFO [M:0;jenkins-hbase9:39303] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:56:09,997 DEBUG [M:0;jenkins-hbase9:39303] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:56:09,997 DEBUG [M:0;jenkins-hbase9:39303] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 10:56:09,997 DEBUG [M:0;jenkins-hbase9:39303] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:56:09,998 INFO [M:0;jenkins-hbase9:39303] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.70 KB heapSize=451.93 KB 2023-07-12 10:56:10,012 INFO [M:0;jenkins-hbase9:39303] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.70 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f65a2b16b48b4852bc52848a48e01fe3 2023-07-12 10:56:10,017 INFO [M:0;jenkins-hbase9:39303] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f65a2b16b48b4852bc52848a48e01fe3 2023-07-12 10:56:10,017 DEBUG [M:0;jenkins-hbase9:39303] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f65a2b16b48b4852bc52848a48e01fe3 as hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f65a2b16b48b4852bc52848a48e01fe3 2023-07-12 10:56:10,022 INFO [M:0;jenkins-hbase9:39303] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f65a2b16b48b4852bc52848a48e01fe3 2023-07-12 10:56:10,022 INFO [M:0;jenkins-hbase9:39303] regionserver.HStore(1080): Added hdfs://localhost:44111/user/jenkins/test-data/45b6a7b4-a24e-c63b-eb86-490f4d0f2648/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f65a2b16b48b4852bc52848a48e01fe3, entries=119, sequenceid=899, filesize=28.6 K 2023-07-12 10:56:10,023 INFO [M:0;jenkins-hbase9:39303] regionserver.HRegion(2948): Finished flush of dataSize ~375.70 KB/384719, heapSize ~451.91 KB/462760, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=899, compaction requested=false 2023-07-12 10:56:10,024 INFO [M:0;jenkins-hbase9:39303] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 10:56:10,024 DEBUG [M:0;jenkins-hbase9:39303] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 10:56:10,028 INFO [M:0;jenkins-hbase9:39303] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 10:56:10,030 INFO [M:0;jenkins-hbase9:39303] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39303 2023-07-12 10:56:10,030 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 10:56:10,032 DEBUG [M:0;jenkins-hbase9:39303] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,39303,1689159208284 already deleted, retry=false 2023-07-12 10:56:10,086 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:10,086 INFO [RS:2;jenkins-hbase9:46191] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,46191,1689159209855; zookeeper connection closed. 2023-07-12 10:56:10,086 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:46191-0x101591ccd770003, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:10,086 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4d975d06] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4d975d06 2023-07-12 10:56:10,186 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:10,186 INFO [M:0;jenkins-hbase9:39303] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,39303,1689159208284; zookeeper connection closed. 2023-07-12 10:56:10,186 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): master:39303-0x101591ccd770000, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:10,286 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:10,286 INFO [RS:1;jenkins-hbase9:36981] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,36981,1689159209821; zookeeper connection closed. 2023-07-12 10:56:10,286 DEBUG [Listener at localhost/38383-EventThread] zookeeper.ZKWatcher(600): regionserver:36981-0x101591ccd770002, quorum=127.0.0.1:53362, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 10:56:10,286 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@66fd4972] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@66fd4972 2023-07-12 10:56:10,287 INFO [Listener at jenkins-hbase9.apache.org/45227] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 10:56:10,287 WARN [Listener at jenkins-hbase9.apache.org/45227] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 10:56:10,291 INFO [Listener at jenkins-hbase9.apache.org/45227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 10:56:10,394 WARN [BP-378587771-172.31.2.10-1689159204177 heartbeating to localhost/127.0.0.1:44111] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 10:56:10,394 WARN [BP-378587771-172.31.2.10-1689159204177 heartbeating to localhost/127.0.0.1:44111] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-378587771-172.31.2.10-1689159204177 (Datanode Uuid 14598a12-3001-40cf-8d14-b421c7606a00) service to localhost/127.0.0.1:44111 2023-07-12 10:56:10,396 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/dfs/data/data5/current/BP-378587771-172.31.2.10-1689159204177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 10:56:10,397 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/dfs/data/data6/current/BP-378587771-172.31.2.10-1689159204177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 10:56:10,398 WARN [Listener at jenkins-hbase9.apache.org/45227] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 10:56:10,401 INFO [Listener at jenkins-hbase9.apache.org/45227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 10:56:10,405 WARN [BP-378587771-172.31.2.10-1689159204177 heartbeating to localhost/127.0.0.1:44111] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 10:56:10,405 WARN [BP-378587771-172.31.2.10-1689159204177 heartbeating to localhost/127.0.0.1:44111] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-378587771-172.31.2.10-1689159204177 (Datanode Uuid d50ae1d8-690c-4b7d-a585-de840c0c4e36) service to localhost/127.0.0.1:44111 2023-07-12 10:56:10,406 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/dfs/data/data3/current/BP-378587771-172.31.2.10-1689159204177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 10:56:10,407 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/dfs/data/data4/current/BP-378587771-172.31.2.10-1689159204177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 10:56:10,408 WARN [Listener at jenkins-hbase9.apache.org/45227] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 10:56:10,410 INFO [Listener at jenkins-hbase9.apache.org/45227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 10:56:10,513 WARN [BP-378587771-172.31.2.10-1689159204177 heartbeating to localhost/127.0.0.1:44111] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 10:56:10,513 WARN [BP-378587771-172.31.2.10-1689159204177 heartbeating to localhost/127.0.0.1:44111] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-378587771-172.31.2.10-1689159204177 (Datanode Uuid e330bc36-ab05-4539-9cc3-3850a5ee9264) service to localhost/127.0.0.1:44111 2023-07-12 10:56:10,514 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/dfs/data/data1/current/BP-378587771-172.31.2.10-1689159204177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 10:56:10,514 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3a94dd62-f94b-ec5f-1157-350bacb6c5c7/cluster_48e19695-e31a-9b78-7b81-a6b7646e0f19/dfs/data/data2/current/BP-378587771-172.31.2.10-1689159204177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 10:56:10,536 INFO [Listener at jenkins-hbase9.apache.org/45227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 10:56:10,670 INFO [Listener at jenkins-hbase9.apache.org/45227] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 10:56:10,772 INFO [Listener at jenkins-hbase9.apache.org/45227] hbase.HBaseTestingUtility(1293): Minicluster is down