2023-09-13 21:00:09,759 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-13 21:00:09,959 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b 2023-09-13 21:00:09,959 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-13 21:00:09,960 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-13 21:00:10,002 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-13 21:00:10,265 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-13 21:00:10,266 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d, deleteOnExit=true 2023-09-13 21:00:10,266 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-13 21:00:10,267 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/test.cache.data in system properties and HBase conf 2023-09-13 21:00:10,268 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop.tmp.dir in system properties and HBase conf 2023-09-13 21:00:10,268 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop.log.dir in system properties and HBase conf 2023-09-13 21:00:10,269 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-13 21:00:10,269 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-13 21:00:10,270 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-13 21:00:10,602 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-13 21:00:10,606 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-13 21:00:10,607 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-13 21:00:10,607 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-13 21:00:10,607 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-13 21:00:10,608 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-13 21:00:10,608 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-13 21:00:10,608 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-13 21:00:10,608 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-13 21:00:10,609 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-13 21:00:10,609 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/nfs.dump.dir in system properties and HBase conf 2023-09-13 21:00:10,609 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/java.io.tmpdir in system properties and HBase conf 2023-09-13 21:00:10,609 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-13 21:00:10,610 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-13 21:00:10,610 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-13 21:00:11,110 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-13 21:00:11,114 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-13 21:00:11,443 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-13 21:00:11,620 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-13 21:00:11,634 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 21:00:11,672 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 21:00:11,709 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/java.io.tmpdir/Jetty_localhost_33299_hdfs____.hs2bqc/webapp 2023-09-13 21:00:11,874 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33299 2023-09-13 21:00:11,885 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-13 21:00:11,886 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-13 21:00:12,366 WARN [Listener at localhost/45325] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-13 21:00:12,448 WARN [Listener at localhost/45325] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-13 21:00:12,470 WARN [Listener at localhost/45325] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 21:00:12,529 INFO [Listener at localhost/45325] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 21:00:12,537 INFO [Listener at localhost/45325] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/java.io.tmpdir/Jetty_localhost_36067_datanode____.1yzxwr/webapp 2023-09-13 21:00:12,656 INFO [Listener at localhost/45325] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36067 2023-09-13 21:00:13,049 WARN [Listener at localhost/41889] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-13 21:00:13,061 WARN [Listener at localhost/41889] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-13 21:00:13,067 WARN [Listener at localhost/41889] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 21:00:13,069 INFO [Listener at localhost/41889] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 21:00:13,078 INFO [Listener at localhost/41889] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/java.io.tmpdir/Jetty_localhost_38993_datanode____.d8hl6z/webapp 2023-09-13 21:00:13,180 INFO [Listener at localhost/41889] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38993 2023-09-13 21:00:13,188 WARN [Listener at localhost/42305] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-13 21:00:13,208 WARN [Listener at localhost/42305] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-13 21:00:13,212 WARN [Listener at localhost/42305] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 21:00:13,214 INFO [Listener at localhost/42305] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 21:00:13,222 INFO [Listener at localhost/42305] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/java.io.tmpdir/Jetty_localhost_46343_datanode____.aq3e95/webapp 2023-09-13 21:00:13,357 INFO [Listener at localhost/42305] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46343 2023-09-13 21:00:13,376 WARN [Listener at localhost/33019] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-13 21:00:13,640 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd0e8e7439940057a: Processing first storage report for DS-f04bbe95-eb41-474b-8553-f9c253ec58ef from datanode 22183a06-7d67-4386-a8a1-86aadbef7e9a 2023-09-13 21:00:13,642 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd0e8e7439940057a: from storage DS-f04bbe95-eb41-474b-8553-f9c253ec58ef node DatanodeRegistration(127.0.0.1:38125, datanodeUuid=22183a06-7d67-4386-a8a1-86aadbef7e9a, infoPort=37351, infoSecurePort=0, ipcPort=41889, storageInfo=lv=-57;cid=testClusterID;nsid=2040615956;c=1694638811202), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-09-13 21:00:13,643 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa8bccb11b3f3e09f: Processing first storage report for DS-f0ab22f5-7a3f-41e4-acba-0583039243e2 from datanode 533fc127-a4d6-4659-a1c3-735037c13115 2023-09-13 21:00:13,643 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa8bccb11b3f3e09f: from storage DS-f0ab22f5-7a3f-41e4-acba-0583039243e2 node DatanodeRegistration(127.0.0.1:45459, datanodeUuid=533fc127-a4d6-4659-a1c3-735037c13115, infoPort=44153, infoSecurePort=0, ipcPort=42305, storageInfo=lv=-57;cid=testClusterID;nsid=2040615956;c=1694638811202), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-13 21:00:13,643 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x876f79a5dfadd4aa: Processing first storage report for DS-a5eb11cc-436d-43a0-aff0-e2ea90168a62 from datanode d33da6d0-5ac3-46ae-b04f-c81bb8776361 2023-09-13 21:00:13,643 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x876f79a5dfadd4aa: from storage DS-a5eb11cc-436d-43a0-aff0-e2ea90168a62 node DatanodeRegistration(127.0.0.1:43817, datanodeUuid=d33da6d0-5ac3-46ae-b04f-c81bb8776361, infoPort=39411, infoSecurePort=0, ipcPort=33019, storageInfo=lv=-57;cid=testClusterID;nsid=2040615956;c=1694638811202), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-13 21:00:13,643 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd0e8e7439940057a: Processing first storage report for DS-6a1940d8-d09e-46dc-bd0b-6b9f70aff960 from datanode 22183a06-7d67-4386-a8a1-86aadbef7e9a 2023-09-13 21:00:13,644 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd0e8e7439940057a: from storage DS-6a1940d8-d09e-46dc-bd0b-6b9f70aff960 node DatanodeRegistration(127.0.0.1:38125, datanodeUuid=22183a06-7d67-4386-a8a1-86aadbef7e9a, infoPort=37351, infoSecurePort=0, ipcPort=41889, storageInfo=lv=-57;cid=testClusterID;nsid=2040615956;c=1694638811202), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-13 21:00:13,644 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa8bccb11b3f3e09f: Processing first storage report for DS-7fcda48d-1089-46a9-9aef-a7712cf66f6e from datanode 533fc127-a4d6-4659-a1c3-735037c13115 2023-09-13 21:00:13,644 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa8bccb11b3f3e09f: from storage DS-7fcda48d-1089-46a9-9aef-a7712cf66f6e node DatanodeRegistration(127.0.0.1:45459, datanodeUuid=533fc127-a4d6-4659-a1c3-735037c13115, infoPort=44153, infoSecurePort=0, ipcPort=42305, storageInfo=lv=-57;cid=testClusterID;nsid=2040615956;c=1694638811202), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-13 21:00:13,644 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x876f79a5dfadd4aa: Processing first storage report for DS-497ec7c3-ba8a-43a0-b129-b143efe06599 from datanode d33da6d0-5ac3-46ae-b04f-c81bb8776361 2023-09-13 21:00:13,645 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x876f79a5dfadd4aa: from storage DS-497ec7c3-ba8a-43a0-b129-b143efe06599 node DatanodeRegistration(127.0.0.1:43817, datanodeUuid=d33da6d0-5ac3-46ae-b04f-c81bb8776361, infoPort=39411, infoSecurePort=0, ipcPort=33019, storageInfo=lv=-57;cid=testClusterID;nsid=2040615956;c=1694638811202), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-13 21:00:14,006 DEBUG [Listener at localhost/33019] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b 2023-09-13 21:00:14,104 INFO [Listener at localhost/33019] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/zookeeper_0, clientPort=61376, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-13 21:00:14,131 INFO [Listener at localhost/33019] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61376 2023-09-13 21:00:14,143 INFO [Listener at localhost/33019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 21:00:14,146 INFO [Listener at localhost/33019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 21:00:14,868 INFO [Listener at localhost/33019] util.FSUtils(471): Created version file at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 with version=8 2023-09-13 21:00:14,868 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/hbase-staging 2023-09-13 21:00:15,241 INFO [Listener at localhost/33019] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-13 21:00:15,747 INFO [Listener at localhost/33019] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-13 21:00:15,780 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 21:00:15,780 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-13 21:00:15,780 INFO [Listener at localhost/33019] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-13 21:00:15,781 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 21:00:15,781 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-13 21:00:15,921 INFO [Listener at localhost/33019] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-13 21:00:15,999 DEBUG [Listener at localhost/33019] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-13 21:00:16,090 INFO [Listener at localhost/33019] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33631 2023-09-13 21:00:16,103 INFO [Listener at localhost/33019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 21:00:16,105 INFO [Listener at localhost/33019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 21:00:16,128 INFO [Listener at localhost/33019] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33631 connecting to ZooKeeper ensemble=127.0.0.1:61376 2023-09-13 21:00:16,184 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:336310x0, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-13 21:00:16,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33631-0x100a7176b200000 connected 2023-09-13 21:00:16,220 DEBUG [Listener at localhost/33019] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 21:00:16,221 DEBUG [Listener at localhost/33019] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 21:00:16,234 DEBUG [Listener at localhost/33019] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-13 21:00:16,242 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33631 2023-09-13 21:00:16,242 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33631 2023-09-13 21:00:16,243 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33631 2023-09-13 21:00:16,243 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33631 2023-09-13 21:00:16,243 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33631 2023-09-13 21:00:16,249 INFO [Listener at localhost/33019] master.HMaster(444): hbase.rootdir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19, hbase.cluster.distributed=false 2023-09-13 21:00:16,311 INFO [Listener at localhost/33019] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-13 21:00:16,312 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 21:00:16,312 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-13 21:00:16,312 INFO [Listener at localhost/33019] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-13 21:00:16,312 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 21:00:16,312 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-13 21:00:16,317 INFO [Listener at localhost/33019] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-13 21:00:16,320 INFO [Listener at localhost/33019] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42107 2023-09-13 21:00:16,323 INFO [Listener at localhost/33019] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-13 21:00:16,329 INFO [Listener at localhost/33019] mob.MobFileCache(124): MobFileCache disabled 2023-09-13 21:00:16,330 INFO [Listener at localhost/33019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 21:00:16,332 INFO [Listener at localhost/33019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 21:00:16,335 INFO [Listener at localhost/33019] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42107 connecting to ZooKeeper ensemble=127.0.0.1:61376 2023-09-13 21:00:16,340 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:421070x0, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-13 21:00:16,341 DEBUG [Listener at localhost/33019] zookeeper.ZKUtil(164): regionserver:421070x0, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 21:00:16,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42107-0x100a7176b200001 connected 2023-09-13 21:00:16,343 DEBUG [Listener at localhost/33019] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 21:00:16,344 DEBUG [Listener at localhost/33019] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-13 21:00:16,344 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42107 2023-09-13 21:00:16,344 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42107 2023-09-13 21:00:16,345 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42107 2023-09-13 21:00:16,345 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42107 2023-09-13 21:00:16,346 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42107 2023-09-13 21:00:16,359 INFO [Listener at localhost/33019] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-13 21:00:16,359 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 21:00:16,359 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-13 21:00:16,359 INFO [Listener at localhost/33019] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-13 21:00:16,360 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 21:00:16,360 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-13 21:00:16,360 INFO [Listener at localhost/33019] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-13 21:00:16,361 INFO [Listener at localhost/33019] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43255 2023-09-13 21:00:16,362 INFO [Listener at localhost/33019] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-13 21:00:16,363 INFO [Listener at localhost/33019] mob.MobFileCache(124): MobFileCache disabled 2023-09-13 21:00:16,364 INFO [Listener at localhost/33019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 21:00:16,367 INFO [Listener at localhost/33019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 21:00:16,370 INFO [Listener at localhost/33019] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43255 connecting to ZooKeeper ensemble=127.0.0.1:61376 2023-09-13 21:00:16,373 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:432550x0, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-13 21:00:16,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43255-0x100a7176b200002 connected 2023-09-13 21:00:16,375 DEBUG [Listener at localhost/33019] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 21:00:16,375 DEBUG [Listener at localhost/33019] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 21:00:16,376 DEBUG [Listener at localhost/33019] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-13 21:00:16,377 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43255 2023-09-13 21:00:16,380 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43255 2023-09-13 21:00:16,381 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43255 2023-09-13 21:00:16,382 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43255 2023-09-13 21:00:16,383 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43255 2023-09-13 21:00:16,395 INFO [Listener at localhost/33019] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-13 21:00:16,395 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 21:00:16,395 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-13 21:00:16,395 INFO [Listener at localhost/33019] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-13 21:00:16,395 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 21:00:16,395 INFO [Listener at localhost/33019] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-13 21:00:16,395 INFO [Listener at localhost/33019] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-13 21:00:16,397 INFO [Listener at localhost/33019] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44809 2023-09-13 21:00:16,397 INFO [Listener at localhost/33019] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-13 21:00:16,400 INFO [Listener at localhost/33019] mob.MobFileCache(124): MobFileCache disabled 2023-09-13 21:00:16,401 INFO [Listener at localhost/33019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 21:00:16,402 INFO [Listener at localhost/33019] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 21:00:16,404 INFO [Listener at localhost/33019] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44809 connecting to ZooKeeper ensemble=127.0.0.1:61376 2023-09-13 21:00:16,407 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:448090x0, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-13 21:00:16,408 DEBUG [Listener at localhost/33019] zookeeper.ZKUtil(164): regionserver:448090x0, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 21:00:16,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44809-0x100a7176b200003 connected 2023-09-13 21:00:16,409 DEBUG [Listener at localhost/33019] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 21:00:16,410 DEBUG [Listener at localhost/33019] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-13 21:00:16,413 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44809 2023-09-13 21:00:16,413 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44809 2023-09-13 21:00:16,413 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44809 2023-09-13 21:00:16,414 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44809 2023-09-13 21:00:16,414 DEBUG [Listener at localhost/33019] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44809 2023-09-13 21:00:16,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33631,1694638815069 2023-09-13 21:00:16,424 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-13 21:00:16,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33631,1694638815069 2023-09-13 21:00:16,449 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-13 21:00:16,450 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-13 21:00:16,449 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-13 21:00:16,449 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-13 21:00:16,450 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 21:00:16,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-13 21:00:16,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33631,1694638815069 from backup master directory 2023-09-13 21:00:16,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-13 21:00:16,457 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33631,1694638815069 2023-09-13 21:00:16,458 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-13 21:00:16,459 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-13 21:00:16,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33631,1694638815069 2023-09-13 21:00:16,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-13 21:00:16,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-13 21:00:16,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/hbase.id with ID: 0e98cfed-9370-46bf-ba65-e87d411e8278 2023-09-13 21:00:16,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 21:00:16,636 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 21:00:16,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1581a3df to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:16,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a2b092f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:16,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-13 21:00:16,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-13 21:00:16,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-13 21:00:16,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-13 21:00:16,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-13 21:00:16,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-13 21:00:16,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 21:00:16,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/MasterData/data/master/store-tmp 2023-09-13 21:00:16,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:16,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-13 21:00:16,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 21:00:16,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 21:00:16,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-13 21:00:16,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 21:00:16,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 21:00:16,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-13 21:00:16,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/MasterData/WALs/jenkins-hbase4.apache.org,33631,1694638815069 2023-09-13 21:00:16,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33631%2C1694638815069, suffix=, logDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/MasterData/WALs/jenkins-hbase4.apache.org,33631,1694638815069, archiveDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/MasterData/oldWALs, maxLogs=10 2023-09-13 21:00:16,941 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43817,DS-a5eb11cc-436d-43a0-aff0-e2ea90168a62,DISK] 2023-09-13 21:00:16,941 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38125,DS-f04bbe95-eb41-474b-8553-f9c253ec58ef,DISK] 2023-09-13 21:00:16,941 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45459,DS-f0ab22f5-7a3f-41e4-acba-0583039243e2,DISK] 2023-09-13 21:00:16,950 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-13 21:00:17,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/MasterData/WALs/jenkins-hbase4.apache.org,33631,1694638815069/jenkins-hbase4.apache.org%2C33631%2C1694638815069.1694638816890 2023-09-13 21:00:17,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43817,DS-a5eb11cc-436d-43a0-aff0-e2ea90168a62,DISK], DatanodeInfoWithStorage[127.0.0.1:45459,DS-f0ab22f5-7a3f-41e4-acba-0583039243e2,DISK], DatanodeInfoWithStorage[127.0.0.1:38125,DS-f04bbe95-eb41-474b-8553-f9c253ec58ef,DISK]] 2023-09-13 21:00:17,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-13 21:00:17,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:17,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-13 21:00:17,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-13 21:00:17,090 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-13 21:00:17,097 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-13 21:00:17,124 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-13 21:00:17,137 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:17,142 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-13 21:00:17,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-13 21:00:17,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-13 21:00:17,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:00:17,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69868318, jitterRate=0.04111906886100769}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:00:17,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-13 21:00:17,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-13 21:00:17,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-13 21:00:17,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-13 21:00:17,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-13 21:00:17,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-13 21:00:17,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-09-13 21:00:17,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-13 21:00:17,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-13 21:00:17,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-13 21:00:17,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-13 21:00:17,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-13 21:00:17,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-13 21:00:17,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-13 21:00:17,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-13 21:00:17,305 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 21:00:17,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-13 21:00:17,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-13 21:00:17,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-13 21:00:17,327 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-13 21:00:17,327 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-13 21:00:17,327 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-13 21:00:17,327 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-13 21:00:17,327 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 21:00:17,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33631,1694638815069, sessionid=0x100a7176b200000, setting cluster-up flag (Was=false) 2023-09-13 21:00:17,349 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 21:00:17,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-13 21:00:17,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33631,1694638815069 2023-09-13 21:00:17,367 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 21:00:17,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-13 21:00:17,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33631,1694638815069 2023-09-13 21:00:17,377 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp 2023-09-13 21:00:17,418 INFO [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(951): ClusterId : 0e98cfed-9370-46bf-ba65-e87d411e8278 2023-09-13 21:00:17,419 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(951): ClusterId : 0e98cfed-9370-46bf-ba65-e87d411e8278 2023-09-13 21:00:17,418 INFO [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(951): ClusterId : 0e98cfed-9370-46bf-ba65-e87d411e8278 2023-09-13 21:00:17,424 DEBUG [RS:2;jenkins-hbase4:44809] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-13 21:00:17,424 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-13 21:00:17,424 DEBUG [RS:1;jenkins-hbase4:43255] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-13 21:00:17,432 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-13 21:00:17,432 DEBUG [RS:2;jenkins-hbase4:44809] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-13 21:00:17,432 DEBUG [RS:1;jenkins-hbase4:43255] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-13 21:00:17,433 DEBUG [RS:2;jenkins-hbase4:44809] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-13 21:00:17,432 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-13 21:00:17,433 DEBUG [RS:1;jenkins-hbase4:43255] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-13 21:00:17,436 DEBUG [RS:2;jenkins-hbase4:44809] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-13 21:00:17,436 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-13 21:00:17,436 DEBUG [RS:1;jenkins-hbase4:43255] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-13 21:00:17,440 DEBUG [RS:2;jenkins-hbase4:44809] zookeeper.ReadOnlyZKClient(139): Connect 0x4e5f4585 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:17,441 DEBUG [RS:1;jenkins-hbase4:43255] zookeeper.ReadOnlyZKClient(139): Connect 0x3f4290a1 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:17,442 DEBUG [RS:0;jenkins-hbase4:42107] zookeeper.ReadOnlyZKClient(139): Connect 0x4b2e4d2a to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:17,449 DEBUG [RS:1;jenkins-hbase4:43255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31856939, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:17,449 DEBUG [RS:2;jenkins-hbase4:44809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4098b23e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:17,450 DEBUG [RS:1;jenkins-hbase4:43255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35bafbd1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-13 21:00:17,450 DEBUG [RS:2;jenkins-hbase4:44809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44a72ef5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-13 21:00:17,469 DEBUG [RS:0;jenkins-hbase4:42107] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45e9aa3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:17,469 DEBUG [RS:0;jenkins-hbase4:42107] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41d6265a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-13 21:00:17,489 DEBUG [RS:2;jenkins-hbase4:44809] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:44809 2023-09-13 21:00:17,489 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42107 2023-09-13 21:00:17,493 DEBUG [RS:1;jenkins-hbase4:43255] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43255 2023-09-13 21:00:17,494 INFO [RS:2;jenkins-hbase4:44809] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-13 21:00:17,494 INFO [RS:1;jenkins-hbase4:43255] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-13 21:00:17,496 INFO [RS:2;jenkins-hbase4:44809] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-13 21:00:17,494 INFO [RS:0;jenkins-hbase4:42107] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-13 21:00:17,496 INFO [RS:0;jenkins-hbase4:42107] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-13 21:00:17,496 INFO [RS:1;jenkins-hbase4:43255] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-13 21:00:17,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-13 21:00:17,522 DEBUG [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-13 21:00:17,522 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-13 21:00:17,522 DEBUG [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-13 21:00:17,525 INFO [RS:2;jenkins-hbase4:44809] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:00:17,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:00:17,525 DEBUG [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(1022): About to register with Master. 2023-09-13 21:00:17,525 INFO [RS:0;jenkins-hbase4:42107] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:00:17,525 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1022): About to register with Master. 2023-09-13 21:00:17,525 INFO [RS:1;jenkins-hbase4:43255] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:00:17,526 DEBUG [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(1022): About to register with Master. 2023-09-13 21:00:17,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-13 21:00:17,528 INFO [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33631,1694638815069 with isa=jenkins-hbase4.apache.org/172.31.14.131:43255, startcode=1694638816358 2023-09-13 21:00:17,528 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33631,1694638815069 with isa=jenkins-hbase4.apache.org/172.31.14.131:42107, startcode=1694638816311 2023-09-13 21:00:17,528 INFO [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33631,1694638815069 with isa=jenkins-hbase4.apache.org/172.31.14.131:44809, startcode=1694638816394 2023-09-13 21:00:17,547 DEBUG [RS:1;jenkins-hbase4:43255] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-13 21:00:17,547 DEBUG [RS:0;jenkins-hbase4:42107] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-13 21:00:17,547 DEBUG [RS:2;jenkins-hbase4:44809] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-13 21:00:17,605 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36153, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-13 21:00:17,605 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46451, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-13 21:00:17,605 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50389, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-13 21:00:17,615 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33631] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-13 21:00:17,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-13 21:00:17,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-13 21:00:17,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-13 21:00:17,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-13 21:00:17,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-13 21:00:17,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-13 21:00:17,627 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33631] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-13 21:00:17,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-13 21:00:17,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,628 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33631] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-13 21:00:17,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1694638847630 2023-09-13 21:00:17,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-13 21:00:17,641 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-13 21:00:17,642 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-13 21:00:17,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-13 21:00:17,648 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-13 21:00:17,653 DEBUG [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(2830): Master is not running yet 2023-09-13 21:00:17,653 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(2830): Master is not running yet 2023-09-13 21:00:17,654 WARN [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-13 21:00:17,653 DEBUG [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(2830): Master is not running yet 2023-09-13 21:00:17,654 WARN [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-13 21:00:17,654 WARN [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-13 21:00:17,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-13 21:00:17,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-13 21:00:17,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-13 21:00:17,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-13 21:00:17,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-13 21:00:17,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-13 21:00:17,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-13 21:00:17,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-13 21:00:17,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-13 21:00:17,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694638817664,5,FailOnTimeoutGroup] 2023-09-13 21:00:17,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694638817664,5,FailOnTimeoutGroup] 2023-09-13 21:00:17,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-13 21:00:17,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,689 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-13 21:00:17,690 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-13 21:00:17,690 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:00:17,712 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:17,714 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-13 21:00:17,716 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/info 2023-09-13 21:00:17,717 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-13 21:00:17,718 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:17,718 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-13 21:00:17,721 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/rep_barrier 2023-09-13 21:00:17,721 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-13 21:00:17,722 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:17,722 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-13 21:00:17,724 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/table 2023-09-13 21:00:17,725 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-13 21:00:17,725 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:17,727 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740 2023-09-13 21:00:17,728 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740 2023-09-13 21:00:17,731 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-13 21:00:17,733 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-13 21:00:17,737 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:00:17,738 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71042852, jitterRate=0.058620989322662354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-13 21:00:17,738 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-13 21:00:17,739 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-13 21:00:17,739 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-13 21:00:17,739 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-13 21:00:17,739 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-13 21:00:17,739 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-13 21:00:17,750 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-13 21:00:17,750 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-13 21:00:17,755 INFO [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33631,1694638815069 with isa=jenkins-hbase4.apache.org/172.31.14.131:44809, startcode=1694638816394 2023-09-13 21:00:17,755 INFO [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33631,1694638815069 with isa=jenkins-hbase4.apache.org/172.31.14.131:43255, startcode=1694638816358 2023-09-13 21:00:17,755 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33631,1694638815069 with isa=jenkins-hbase4.apache.org/172.31.14.131:42107, startcode=1694638816311 2023-09-13 21:00:17,757 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-13 21:00:17,757 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-13 21:00:17,763 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33631] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:17,770 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33631] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:17,771 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33631] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:17,771 DEBUG [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:00:17,771 DEBUG [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45325 2023-09-13 21:00:17,771 DEBUG [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-13 21:00:17,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-13 21:00:17,772 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:00:17,772 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45325 2023-09-13 21:00:17,773 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-13 21:00:17,773 DEBUG [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:00:17,773 DEBUG [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45325 2023-09-13 21:00:17,773 DEBUG [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-13 21:00:17,778 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 21:00:17,784 DEBUG [RS:1;jenkins-hbase4:43255] zookeeper.ZKUtil(162): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:17,784 WARN [RS:1;jenkins-hbase4:43255] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-13 21:00:17,784 INFO [RS:1;jenkins-hbase4:43255] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 21:00:17,785 DEBUG [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/WALs/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:17,785 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42107,1694638816311] 2023-09-13 21:00:17,785 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44809,1694638816394] 2023-09-13 21:00:17,785 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43255,1694638816358] 2023-09-13 21:00:17,786 DEBUG [RS:2;jenkins-hbase4:44809] zookeeper.ZKUtil(162): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:17,786 WARN [RS:2;jenkins-hbase4:44809] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-13 21:00:17,786 DEBUG [RS:0;jenkins-hbase4:42107] zookeeper.ZKUtil(162): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:17,787 INFO [RS:2;jenkins-hbase4:44809] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 21:00:17,787 WARN [RS:0;jenkins-hbase4:42107] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-13 21:00:17,787 DEBUG [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/WALs/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:17,787 INFO [RS:0;jenkins-hbase4:42107] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 21:00:17,787 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/WALs/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:17,790 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-13 21:00:17,796 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-13 21:00:17,802 DEBUG [RS:0;jenkins-hbase4:42107] zookeeper.ZKUtil(162): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:17,802 DEBUG [RS:1;jenkins-hbase4:43255] zookeeper.ZKUtil(162): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:17,802 DEBUG [RS:2;jenkins-hbase4:44809] zookeeper.ZKUtil(162): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:17,803 DEBUG [RS:0;jenkins-hbase4:42107] zookeeper.ZKUtil(162): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:17,803 DEBUG [RS:2;jenkins-hbase4:44809] zookeeper.ZKUtil(162): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:17,803 DEBUG [RS:1;jenkins-hbase4:43255] zookeeper.ZKUtil(162): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:17,803 DEBUG [RS:0;jenkins-hbase4:42107] zookeeper.ZKUtil(162): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:17,803 DEBUG [RS:2;jenkins-hbase4:44809] zookeeper.ZKUtil(162): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:17,803 DEBUG [RS:1;jenkins-hbase4:43255] zookeeper.ZKUtil(162): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:17,816 DEBUG [RS:2;jenkins-hbase4:44809] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-13 21:00:17,816 DEBUG [RS:1;jenkins-hbase4:43255] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-13 21:00:17,816 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-13 21:00:17,826 INFO [RS:0;jenkins-hbase4:42107] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-13 21:00:17,826 INFO [RS:2;jenkins-hbase4:44809] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-13 21:00:17,826 INFO [RS:1;jenkins-hbase4:43255] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-13 21:00:17,851 INFO [RS:1;jenkins-hbase4:43255] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-13 21:00:17,851 INFO [RS:2;jenkins-hbase4:44809] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-13 21:00:17,851 INFO [RS:0;jenkins-hbase4:42107] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-13 21:00:17,856 INFO [RS:2;jenkins-hbase4:44809] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-13 21:00:17,856 INFO [RS:1;jenkins-hbase4:43255] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-13 21:00:17,856 INFO [RS:2;jenkins-hbase4:44809] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,856 INFO [RS:0;jenkins-hbase4:42107] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-13 21:00:17,856 INFO [RS:1;jenkins-hbase4:43255] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,857 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,857 INFO [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-13 21:00:17,858 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-13 21:00:17,857 INFO [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-13 21:00:17,866 INFO [RS:2;jenkins-hbase4:44809] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,866 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,866 INFO [RS:1;jenkins-hbase4:43255] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,866 DEBUG [RS:2;jenkins-hbase4:44809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,866 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,867 DEBUG [RS:2;jenkins-hbase4:44809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,867 DEBUG [RS:1;jenkins-hbase4:43255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,867 DEBUG [RS:2;jenkins-hbase4:44809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,867 DEBUG [RS:1;jenkins-hbase4:43255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,867 DEBUG [RS:2;jenkins-hbase4:44809] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,867 DEBUG [RS:1;jenkins-hbase4:43255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,867 DEBUG [RS:2;jenkins-hbase4:44809] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,867 DEBUG [RS:1;jenkins-hbase4:43255] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,867 DEBUG [RS:2;jenkins-hbase4:44809] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-13 21:00:17,867 DEBUG [RS:1;jenkins-hbase4:43255] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,867 DEBUG [RS:2;jenkins-hbase4:44809] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,867 DEBUG [RS:1;jenkins-hbase4:43255] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-13 21:00:17,867 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,867 DEBUG [RS:1;jenkins-hbase4:43255] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,867 DEBUG [RS:2;jenkins-hbase4:44809] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,868 DEBUG [RS:1;jenkins-hbase4:43255] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,868 DEBUG [RS:2;jenkins-hbase4:44809] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,868 DEBUG [RS:1;jenkins-hbase4:43255] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,868 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,868 DEBUG [RS:1;jenkins-hbase4:43255] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,868 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,868 DEBUG [RS:2;jenkins-hbase4:44809] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,868 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,869 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-13 21:00:17,869 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,869 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,869 INFO [RS:2;jenkins-hbase4:44809] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,869 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,870 INFO [RS:2;jenkins-hbase4:44809] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,870 DEBUG [RS:0;jenkins-hbase4:42107] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-13 21:00:17,870 INFO [RS:2;jenkins-hbase4:44809] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,873 INFO [RS:1;jenkins-hbase4:43255] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,873 INFO [RS:1;jenkins-hbase4:43255] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,873 INFO [RS:1;jenkins-hbase4:43255] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,874 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,874 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,874 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,891 INFO [RS:2;jenkins-hbase4:44809] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-13 21:00:17,891 INFO [RS:1;jenkins-hbase4:43255] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-13 21:00:17,891 INFO [RS:0;jenkins-hbase4:42107] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-13 21:00:17,895 INFO [RS:1;jenkins-hbase4:43255] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43255,1694638816358-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,895 INFO [RS:2;jenkins-hbase4:44809] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44809,1694638816394-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,895 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42107,1694638816311-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:17,917 INFO [RS:0;jenkins-hbase4:42107] regionserver.Replication(203): jenkins-hbase4.apache.org,42107,1694638816311 started 2023-09-13 21:00:17,917 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42107,1694638816311, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42107, sessionid=0x100a7176b200001 2023-09-13 21:00:17,921 INFO [RS:2;jenkins-hbase4:44809] regionserver.Replication(203): jenkins-hbase4.apache.org,44809,1694638816394 started 2023-09-13 21:00:17,921 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-13 21:00:17,921 INFO [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44809,1694638816394, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44809, sessionid=0x100a7176b200003 2023-09-13 21:00:17,921 DEBUG [RS:0;jenkins-hbase4:42107] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:17,921 DEBUG [RS:2;jenkins-hbase4:44809] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-13 21:00:17,921 DEBUG [RS:0;jenkins-hbase4:42107] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42107,1694638816311' 2023-09-13 21:00:17,921 INFO [RS:1;jenkins-hbase4:43255] regionserver.Replication(203): jenkins-hbase4.apache.org,43255,1694638816358 started 2023-09-13 21:00:17,922 DEBUG [RS:0;jenkins-hbase4:42107] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-13 21:00:17,921 DEBUG [RS:2;jenkins-hbase4:44809] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:17,922 INFO [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43255,1694638816358, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43255, sessionid=0x100a7176b200002 2023-09-13 21:00:17,922 DEBUG [RS:2;jenkins-hbase4:44809] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44809,1694638816394' 2023-09-13 21:00:17,923 DEBUG [RS:1;jenkins-hbase4:43255] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-13 21:00:17,923 DEBUG [RS:2;jenkins-hbase4:44809] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-13 21:00:17,923 DEBUG [RS:1;jenkins-hbase4:43255] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:17,923 DEBUG [RS:1;jenkins-hbase4:43255] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43255,1694638816358' 2023-09-13 21:00:17,923 DEBUG [RS:1;jenkins-hbase4:43255] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-13 21:00:17,924 DEBUG [RS:0;jenkins-hbase4:42107] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-13 21:00:17,924 DEBUG [RS:2;jenkins-hbase4:44809] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-13 21:00:17,924 DEBUG [RS:1;jenkins-hbase4:43255] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-13 21:00:17,924 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-13 21:00:17,924 DEBUG [RS:2;jenkins-hbase4:44809] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-13 21:00:17,924 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-13 21:00:17,924 DEBUG [RS:2;jenkins-hbase4:44809] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-13 21:00:17,925 DEBUG [RS:1;jenkins-hbase4:43255] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-13 21:00:17,925 DEBUG [RS:0;jenkins-hbase4:42107] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:17,925 DEBUG [RS:1;jenkins-hbase4:43255] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-13 21:00:17,925 DEBUG [RS:2;jenkins-hbase4:44809] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:17,925 DEBUG [RS:2;jenkins-hbase4:44809] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44809,1694638816394' 2023-09-13 21:00:17,925 DEBUG [RS:2;jenkins-hbase4:44809] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:17,925 DEBUG [RS:1;jenkins-hbase4:43255] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:17,925 DEBUG [RS:0;jenkins-hbase4:42107] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42107,1694638816311' 2023-09-13 21:00:17,926 DEBUG [RS:0;jenkins-hbase4:42107] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:17,926 DEBUG [RS:1;jenkins-hbase4:43255] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43255,1694638816358' 2023-09-13 21:00:17,926 DEBUG [RS:1;jenkins-hbase4:43255] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:17,926 DEBUG [RS:2;jenkins-hbase4:44809] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:17,926 DEBUG [RS:1;jenkins-hbase4:43255] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:17,927 DEBUG [RS:0;jenkins-hbase4:42107] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:17,927 DEBUG [RS:1;jenkins-hbase4:43255] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-13 21:00:17,927 INFO [RS:1;jenkins-hbase4:43255] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-13 21:00:17,927 DEBUG [RS:2;jenkins-hbase4:44809] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-13 21:00:17,927 INFO [RS:1;jenkins-hbase4:43255] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-13 21:00:17,927 INFO [RS:2;jenkins-hbase4:44809] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-13 21:00:17,929 DEBUG [RS:0;jenkins-hbase4:42107] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-13 21:00:17,929 INFO [RS:2;jenkins-hbase4:44809] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-13 21:00:17,929 INFO [RS:0;jenkins-hbase4:42107] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-13 21:00:17,929 INFO [RS:0;jenkins-hbase4:42107] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-13 21:00:17,949 DEBUG [jenkins-hbase4:33631] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-13 21:00:17,953 DEBUG [jenkins-hbase4:33631] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 21:00:17,959 DEBUG [jenkins-hbase4:33631] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 21:00:17,959 DEBUG [jenkins-hbase4:33631] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 21:00:17,959 DEBUG [jenkins-hbase4:33631] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 21:00:17,959 DEBUG [jenkins-hbase4:33631] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 21:00:17,962 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43255,1694638816358, state=OPENING 2023-09-13 21:00:17,969 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-13 21:00:17,971 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 21:00:17,971 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-13 21:00:17,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:00:18,040 INFO [RS:1;jenkins-hbase4:43255] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43255%2C1694638816358, suffix=, logDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/WALs/jenkins-hbase4.apache.org,43255,1694638816358, archiveDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/oldWALs, maxLogs=32 2023-09-13 21:00:18,040 INFO [RS:0;jenkins-hbase4:42107] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42107%2C1694638816311, suffix=, logDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/WALs/jenkins-hbase4.apache.org,42107,1694638816311, archiveDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/oldWALs, maxLogs=32 2023-09-13 21:00:18,040 INFO [RS:2;jenkins-hbase4:44809] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44809%2C1694638816394, suffix=, logDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/WALs/jenkins-hbase4.apache.org,44809,1694638816394, archiveDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/oldWALs, maxLogs=32 2023-09-13 21:00:18,074 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43817,DS-a5eb11cc-436d-43a0-aff0-e2ea90168a62,DISK] 2023-09-13 21:00:18,075 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45459,DS-f0ab22f5-7a3f-41e4-acba-0583039243e2,DISK] 2023-09-13 21:00:18,075 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38125,DS-f04bbe95-eb41-474b-8553-f9c253ec58ef,DISK] 2023-09-13 21:00:18,079 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45459,DS-f0ab22f5-7a3f-41e4-acba-0583039243e2,DISK] 2023-09-13 21:00:18,079 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43817,DS-a5eb11cc-436d-43a0-aff0-e2ea90168a62,DISK] 2023-09-13 21:00:18,080 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45459,DS-f0ab22f5-7a3f-41e4-acba-0583039243e2,DISK] 2023-09-13 21:00:18,080 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38125,DS-f04bbe95-eb41-474b-8553-f9c253ec58ef,DISK] 2023-09-13 21:00:18,080 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43817,DS-a5eb11cc-436d-43a0-aff0-e2ea90168a62,DISK] 2023-09-13 21:00:18,080 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38125,DS-f04bbe95-eb41-474b-8553-f9c253ec58ef,DISK] 2023-09-13 21:00:18,095 INFO [RS:0;jenkins-hbase4:42107] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/WALs/jenkins-hbase4.apache.org,42107,1694638816311/jenkins-hbase4.apache.org%2C42107%2C1694638816311.1694638818044 2023-09-13 21:00:18,095 INFO [RS:1;jenkins-hbase4:43255] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/WALs/jenkins-hbase4.apache.org,43255,1694638816358/jenkins-hbase4.apache.org%2C43255%2C1694638816358.1694638818044 2023-09-13 21:00:18,095 INFO [RS:2;jenkins-hbase4:44809] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/WALs/jenkins-hbase4.apache.org,44809,1694638816394/jenkins-hbase4.apache.org%2C44809%2C1694638816394.1694638818044 2023-09-13 21:00:18,096 DEBUG [RS:0;jenkins-hbase4:42107] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43817,DS-a5eb11cc-436d-43a0-aff0-e2ea90168a62,DISK], DatanodeInfoWithStorage[127.0.0.1:45459,DS-f0ab22f5-7a3f-41e4-acba-0583039243e2,DISK], DatanodeInfoWithStorage[127.0.0.1:38125,DS-f04bbe95-eb41-474b-8553-f9c253ec58ef,DISK]] 2023-09-13 21:00:18,097 DEBUG [RS:2;jenkins-hbase4:44809] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43817,DS-a5eb11cc-436d-43a0-aff0-e2ea90168a62,DISK], DatanodeInfoWithStorage[127.0.0.1:38125,DS-f04bbe95-eb41-474b-8553-f9c253ec58ef,DISK], DatanodeInfoWithStorage[127.0.0.1:45459,DS-f0ab22f5-7a3f-41e4-acba-0583039243e2,DISK]] 2023-09-13 21:00:18,101 DEBUG [RS:1;jenkins-hbase4:43255] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45459,DS-f0ab22f5-7a3f-41e4-acba-0583039243e2,DISK], DatanodeInfoWithStorage[127.0.0.1:43817,DS-a5eb11cc-436d-43a0-aff0-e2ea90168a62,DISK], DatanodeInfoWithStorage[127.0.0.1:38125,DS-f04bbe95-eb41-474b-8553-f9c253ec58ef,DISK]] 2023-09-13 21:00:18,164 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:18,166 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 21:00:18,169 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 21:00:18,183 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-13 21:00:18,184 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 21:00:18,187 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43255%2C1694638816358.meta, suffix=.meta, logDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/WALs/jenkins-hbase4.apache.org,43255,1694638816358, archiveDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/oldWALs, maxLogs=32 2023-09-13 21:00:18,213 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45459,DS-f0ab22f5-7a3f-41e4-acba-0583039243e2,DISK] 2023-09-13 21:00:18,214 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38125,DS-f04bbe95-eb41-474b-8553-f9c253ec58ef,DISK] 2023-09-13 21:00:18,214 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43817,DS-a5eb11cc-436d-43a0-aff0-e2ea90168a62,DISK] 2023-09-13 21:00:18,220 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/WALs/jenkins-hbase4.apache.org,43255,1694638816358/jenkins-hbase4.apache.org%2C43255%2C1694638816358.meta.1694638818189.meta 2023-09-13 21:00:18,223 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45459,DS-f0ab22f5-7a3f-41e4-acba-0583039243e2,DISK], DatanodeInfoWithStorage[127.0.0.1:38125,DS-f04bbe95-eb41-474b-8553-f9c253ec58ef,DISK], DatanodeInfoWithStorage[127.0.0.1:43817,DS-a5eb11cc-436d-43a0-aff0-e2ea90168a62,DISK]] 2023-09-13 21:00:18,224 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-13 21:00:18,225 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-13 21:00:18,226 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:00:18,227 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-13 21:00:18,229 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-13 21:00:18,230 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-13 21:00:18,243 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-13 21:00:18,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:18,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-13 21:00:18,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-13 21:00:18,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-13 21:00:18,249 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/info 2023-09-13 21:00:18,249 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/info 2023-09-13 21:00:18,249 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-13 21:00:18,250 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:18,250 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-13 21:00:18,252 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/rep_barrier 2023-09-13 21:00:18,252 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/rep_barrier 2023-09-13 21:00:18,252 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-13 21:00:18,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:18,254 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-13 21:00:18,255 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/table 2023-09-13 21:00:18,255 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/table 2023-09-13 21:00:18,256 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-13 21:00:18,256 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:18,259 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740 2023-09-13 21:00:18,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740 2023-09-13 21:00:18,265 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-13 21:00:18,268 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-13 21:00:18,269 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58902619, jitterRate=-0.12228257954120636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-13 21:00:18,272 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-13 21:00:18,283 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1694638818156 2023-09-13 21:00:18,301 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-13 21:00:18,302 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-13 21:00:18,302 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43255,1694638816358, state=OPEN 2023-09-13 21:00:18,305 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-13 21:00:18,305 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-13 21:00:18,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-13 21:00:18,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43255,1694638816358 in 329 msec 2023-09-13 21:00:18,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-13 21:00:18,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 543 msec 2023-09-13 21:00:18,325 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 789 msec 2023-09-13 21:00:18,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1694638818326, completionTime=-1 2023-09-13 21:00:18,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-13 21:00:18,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-13 21:00:18,399 DEBUG [hconnection-0x5590acd6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:18,402 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:18,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-13 21:00:18,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1694638878424 2023-09-13 21:00:18,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1694638938424 2023-09-13 21:00:18,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 97 msec 2023-09-13 21:00:18,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33631,1694638815069-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:18,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33631,1694638815069-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:18,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33631,1694638815069-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:18,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33631, period=300000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:18,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-13 21:00:18,464 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-13 21:00:18,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-13 21:00:18,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-13 21:00:18,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-13 21:00:18,491 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 21:00:18,493 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 21:00:18,515 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/hbase/namespace/1a7fc3008ef22f78d576b5eff38bc7af 2023-09-13 21:00:18,518 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/hbase/namespace/1a7fc3008ef22f78d576b5eff38bc7af empty. 2023-09-13 21:00:18,519 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/hbase/namespace/1a7fc3008ef22f78d576b5eff38bc7af 2023-09-13 21:00:18,519 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-13 21:00:18,568 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-13 21:00:18,570 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1a7fc3008ef22f78d576b5eff38bc7af, NAME => 'hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:00:18,589 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:18,589 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 1a7fc3008ef22f78d576b5eff38bc7af, disabling compactions & flushes 2023-09-13 21:00:18,589 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. 2023-09-13 21:00:18,589 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. 2023-09-13 21:00:18,589 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. after waiting 0 ms 2023-09-13 21:00:18,590 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. 2023-09-13 21:00:18,590 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. 2023-09-13 21:00:18,590 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 1a7fc3008ef22f78d576b5eff38bc7af: 2023-09-13 21:00:18,594 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 21:00:18,609 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694638818597"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638818597"}]},"ts":"1694638818597"} 2023-09-13 21:00:18,635 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-13 21:00:18,638 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 21:00:18,643 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638818638"}]},"ts":"1694638818638"} 2023-09-13 21:00:18,646 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-13 21:00:18,651 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 21:00:18,652 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 21:00:18,652 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 21:00:18,652 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 21:00:18,652 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 21:00:18,654 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1a7fc3008ef22f78d576b5eff38bc7af, ASSIGN}] 2023-09-13 21:00:18,657 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1a7fc3008ef22f78d576b5eff38bc7af, ASSIGN 2023-09-13 21:00:18,659 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1a7fc3008ef22f78d576b5eff38bc7af, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44809,1694638816394; forceNewPlan=false, retain=false 2023-09-13 21:00:18,811 INFO [jenkins-hbase4:33631] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-13 21:00:18,812 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1a7fc3008ef22f78d576b5eff38bc7af, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:18,813 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694638818812"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638818812"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638818812"}]},"ts":"1694638818812"} 2023-09-13 21:00:18,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1a7fc3008ef22f78d576b5eff38bc7af, server=jenkins-hbase4.apache.org,44809,1694638816394}] 2023-09-13 21:00:18,972 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:18,972 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 21:00:18,976 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 21:00:18,981 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. 2023-09-13 21:00:18,981 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a7fc3008ef22f78d576b5eff38bc7af, NAME => 'hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af.', STARTKEY => '', ENDKEY => ''} 2023-09-13 21:00:18,982 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. service=AccessControlService 2023-09-13 21:00:18,982 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:00:18,983 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1a7fc3008ef22f78d576b5eff38bc7af 2023-09-13 21:00:18,983 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:18,983 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1a7fc3008ef22f78d576b5eff38bc7af 2023-09-13 21:00:18,983 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1a7fc3008ef22f78d576b5eff38bc7af 2023-09-13 21:00:18,985 INFO [StoreOpener-1a7fc3008ef22f78d576b5eff38bc7af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1a7fc3008ef22f78d576b5eff38bc7af 2023-09-13 21:00:18,987 DEBUG [StoreOpener-1a7fc3008ef22f78d576b5eff38bc7af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/namespace/1a7fc3008ef22f78d576b5eff38bc7af/info 2023-09-13 21:00:18,987 DEBUG [StoreOpener-1a7fc3008ef22f78d576b5eff38bc7af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/namespace/1a7fc3008ef22f78d576b5eff38bc7af/info 2023-09-13 21:00:18,988 INFO [StoreOpener-1a7fc3008ef22f78d576b5eff38bc7af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a7fc3008ef22f78d576b5eff38bc7af columnFamilyName info 2023-09-13 21:00:18,988 INFO [StoreOpener-1a7fc3008ef22f78d576b5eff38bc7af-1] regionserver.HStore(310): Store=1a7fc3008ef22f78d576b5eff38bc7af/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:18,990 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/namespace/1a7fc3008ef22f78d576b5eff38bc7af 2023-09-13 21:00:18,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/namespace/1a7fc3008ef22f78d576b5eff38bc7af 2023-09-13 21:00:18,995 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1a7fc3008ef22f78d576b5eff38bc7af 2023-09-13 21:00:18,999 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/namespace/1a7fc3008ef22f78d576b5eff38bc7af/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:00:19,000 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1a7fc3008ef22f78d576b5eff38bc7af; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60636498, jitterRate=-0.09644576907157898}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:00:19,000 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1a7fc3008ef22f78d576b5eff38bc7af: 2023-09-13 21:00:19,003 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af., pid=6, masterSystemTime=1694638818972 2023-09-13 21:00:19,007 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. 2023-09-13 21:00:19,008 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. 2023-09-13 21:00:19,010 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1a7fc3008ef22f78d576b5eff38bc7af, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:19,010 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694638819009"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638819009"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638819009"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638819009"}]},"ts":"1694638819009"} 2023-09-13 21:00:19,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-13 21:00:19,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1a7fc3008ef22f78d576b5eff38bc7af, server=jenkins-hbase4.apache.org,44809,1694638816394 in 196 msec 2023-09-13 21:00:19,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-13 21:00:19,022 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1a7fc3008ef22f78d576b5eff38bc7af, ASSIGN in 363 msec 2023-09-13 21:00:19,024 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 21:00:19,024 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638819024"}]},"ts":"1694638819024"} 2023-09-13 21:00:19,026 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-13 21:00:19,030 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 21:00:19,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 551 msec 2023-09-13 21:00:19,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-13 21:00:19,092 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-13 21:00:19,092 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 21:00:19,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:19,120 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:19,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-13 21:00:19,148 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-13 21:00:19,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-09-13 21:00:19,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-13 21:00:19,181 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-13 21:00:19,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 21 msec 2023-09-13 21:00:19,201 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-13 21:00:19,204 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-13 21:00:19,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.747sec 2023-09-13 21:00:19,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-13 21:00:19,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-13 21:00:19,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-13 21:00:19,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33631,1694638815069-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-13 21:00:19,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33631,1694638815069-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-13 21:00:19,225 DEBUG [Listener at localhost/33019] zookeeper.ReadOnlyZKClient(139): Connect 0x52492d35 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:19,230 DEBUG [Listener at localhost/33019] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@627146cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:19,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-13 21:00:19,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-13 21:00:19,240 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 21:00:19,241 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 21:00:19,245 DEBUG [hconnection-0x3ca857b3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:19,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-13 21:00:19,249 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/hbase/acl/6581cac807262776d608b6587b7b41b8 2023-09-13 21:00:19,250 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/hbase/acl/6581cac807262776d608b6587b7b41b8 empty. 2023-09-13 21:00:19,252 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/hbase/acl/6581cac807262776d608b6587b7b41b8 2023-09-13 21:00:19,252 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-13 21:00:19,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-13 21:00:19,263 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:19,265 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33631,1694638815069 2023-09-13 21:00:19,266 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-13 21:00:19,266 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/test.cache.data in system properties and HBase conf 2023-09-13 21:00:19,266 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop.tmp.dir in system properties and HBase conf 2023-09-13 21:00:19,266 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop.log.dir in system properties and HBase conf 2023-09-13 21:00:19,266 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-13 21:00:19,266 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-13 21:00:19,266 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-13 21:00:19,266 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-13 21:00:19,267 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-13 21:00:19,267 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-13 21:00:19,267 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-13 21:00:19,267 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-13 21:00:19,267 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-13 21:00:19,267 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-13 21:00:19,267 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-13 21:00:19,267 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-13 21:00:19,267 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/nfs.dump.dir in system properties and HBase conf 2023-09-13 21:00:19,267 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/java.io.tmpdir in system properties and HBase conf 2023-09-13 21:00:19,267 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-13 21:00:19,268 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-13 21:00:19,268 INFO [Listener at localhost/33019] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-13 21:00:19,280 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-13 21:00:19,283 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6581cac807262776d608b6587b7b41b8, NAME => 'hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:00:19,306 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:19,306 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 6581cac807262776d608b6587b7b41b8, disabling compactions & flushes 2023-09-13 21:00:19,307 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. 2023-09-13 21:00:19,307 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. 2023-09-13 21:00:19,307 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. after waiting 0 ms 2023-09-13 21:00:19,307 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. 2023-09-13 21:00:19,307 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. 2023-09-13 21:00:19,307 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 6581cac807262776d608b6587b7b41b8: 2023-09-13 21:00:19,311 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 21:00:19,313 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694638819313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638819313"}]},"ts":"1694638819313"} 2023-09-13 21:00:19,328 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-13 21:00:19,333 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 21:00:19,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638819333"}]},"ts":"1694638819333"} 2023-09-13 21:00:19,336 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-13 21:00:19,343 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 21:00:19,344 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 21:00:19,344 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 21:00:19,345 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 21:00:19,345 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 21:00:19,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6581cac807262776d608b6587b7b41b8, ASSIGN}] 2023-09-13 21:00:19,347 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=6581cac807262776d608b6587b7b41b8, ASSIGN 2023-09-13 21:00:19,348 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=6581cac807262776d608b6587b7b41b8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42107,1694638816311; forceNewPlan=false, retain=false 2023-09-13 21:00:19,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-13 21:00:19,499 INFO [jenkins-hbase4:33631] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-13 21:00:19,500 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6581cac807262776d608b6587b7b41b8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:19,501 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694638819500"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638819500"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638819500"}]},"ts":"1694638819500"} 2023-09-13 21:00:19,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 6581cac807262776d608b6587b7b41b8, server=jenkins-hbase4.apache.org,42107,1694638816311}] 2023-09-13 21:00:19,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-13 21:00:19,659 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:19,660 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 21:00:19,663 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 21:00:19,669 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. 2023-09-13 21:00:19,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6581cac807262776d608b6587b7b41b8, NAME => 'hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8.', STARTKEY => '', ENDKEY => ''} 2023-09-13 21:00:19,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. service=AccessControlService 2023-09-13 21:00:19,670 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:00:19,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 6581cac807262776d608b6587b7b41b8 2023-09-13 21:00:19,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:19,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6581cac807262776d608b6587b7b41b8 2023-09-13 21:00:19,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6581cac807262776d608b6587b7b41b8 2023-09-13 21:00:19,673 INFO [StoreOpener-6581cac807262776d608b6587b7b41b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 6581cac807262776d608b6587b7b41b8 2023-09-13 21:00:19,676 DEBUG [StoreOpener-6581cac807262776d608b6587b7b41b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/acl/6581cac807262776d608b6587b7b41b8/l 2023-09-13 21:00:19,676 DEBUG [StoreOpener-6581cac807262776d608b6587b7b41b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/acl/6581cac807262776d608b6587b7b41b8/l 2023-09-13 21:00:19,677 INFO [StoreOpener-6581cac807262776d608b6587b7b41b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6581cac807262776d608b6587b7b41b8 columnFamilyName l 2023-09-13 21:00:19,678 INFO [StoreOpener-6581cac807262776d608b6587b7b41b8-1] regionserver.HStore(310): Store=6581cac807262776d608b6587b7b41b8/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:19,680 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/acl/6581cac807262776d608b6587b7b41b8 2023-09-13 21:00:19,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/acl/6581cac807262776d608b6587b7b41b8 2023-09-13 21:00:19,687 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6581cac807262776d608b6587b7b41b8 2023-09-13 21:00:19,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/acl/6581cac807262776d608b6587b7b41b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:00:19,693 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6581cac807262776d608b6587b7b41b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71695387, jitterRate=0.06834451854228973}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:00:19,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6581cac807262776d608b6587b7b41b8: 2023-09-13 21:00:19,695 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8., pid=11, masterSystemTime=1694638819659 2023-09-13 21:00:19,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. 2023-09-13 21:00:19,700 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. 2023-09-13 21:00:19,701 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6581cac807262776d608b6587b7b41b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:19,701 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694638819701"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638819701"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638819701"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638819701"}]},"ts":"1694638819701"} 2023-09-13 21:00:19,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-13 21:00:19,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 6581cac807262776d608b6587b7b41b8, server=jenkins-hbase4.apache.org,42107,1694638816311 in 200 msec 2023-09-13 21:00:19,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-13 21:00:19,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=6581cac807262776d608b6587b7b41b8, ASSIGN in 365 msec 2023-09-13 21:00:19,715 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 21:00:19,716 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638819715"}]},"ts":"1694638819715"} 2023-09-13 21:00:19,718 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-13 21:00:19,721 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 21:00:19,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 486 msec 2023-09-13 21:00:19,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-13 21:00:19,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-13 21:00:19,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-13 21:00:20,535 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 21:00:20,881 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 21:00:20,888 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43837_jobhistory____.myvjyy/webapp 2023-09-13 21:00:21,050 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-13 21:00:21,050 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-13 21:00:21,050 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-13 21:00:21,054 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-13 21:00:21,142 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 21:00:21,471 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 21:00:21,728 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-13 21:00:21,759 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43837 2023-09-13 21:00:22,028 WARN [Listener at jenkins-hbase4.apache.org/36067] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 21:00:22,309 WARN [Listener at jenkins-hbase4.apache.org/36067] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-13 21:00:22,310 INFO [Listener at jenkins-hbase4.apache.org/36067] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 21:00:22,319 INFO [Listener at jenkins-hbase4.apache.org/36067] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33293_cluster____.3wlmiw/webapp 2023-09-13 21:00:22,395 INFO [Listener at jenkins-hbase4.apache.org/36067] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-13 21:00:22,396 INFO [Listener at jenkins-hbase4.apache.org/36067] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-13 21:00:22,396 INFO [Listener at jenkins-hbase4.apache.org/36067] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-13 21:00:22,396 INFO [Listener at jenkins-hbase4.apache.org/36067] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-13 21:00:22,404 INFO [Listener at jenkins-hbase4.apache.org/36067] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 21:00:22,589 INFO [Listener at jenkins-hbase4.apache.org/36067] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 21:00:22,688 INFO [Listener at jenkins-hbase4.apache.org/36067] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 21:00:22,695 INFO [Listener at jenkins-hbase4.apache.org/36067] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33293 2023-09-13 21:00:23,183 WARN [Listener at jenkins-hbase4.apache.org/34345] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 21:00:23,210 WARN [Listener at jenkins-hbase4.apache.org/34345] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-13 21:00:23,211 INFO [Listener at jenkins-hbase4.apache.org/34345] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 21:00:23,218 INFO [Listener at jenkins-hbase4.apache.org/34345] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43897_node____372cvp/webapp 2023-09-13 21:00:23,303 INFO [Listener at jenkins-hbase4.apache.org/34345] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-13 21:00:23,304 INFO [Listener at jenkins-hbase4.apache.org/34345] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-13 21:00:23,304 INFO [Listener at jenkins-hbase4.apache.org/34345] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-13 21:00:23,304 INFO [Listener at jenkins-hbase4.apache.org/34345] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-13 21:00:23,312 INFO [Listener at jenkins-hbase4.apache.org/34345] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 21:00:23,335 INFO [Listener at jenkins-hbase4.apache.org/34345] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 21:00:23,410 INFO [Listener at jenkins-hbase4.apache.org/34345] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 21:00:23,419 INFO [Listener at jenkins-hbase4.apache.org/34345] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43897 2023-09-13 21:00:23,581 WARN [Listener at jenkins-hbase4.apache.org/36385] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 21:00:23,588 WARN [Listener at jenkins-hbase4.apache.org/36385] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-13 21:00:23,589 INFO [Listener at jenkins-hbase4.apache.org/36385] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 21:00:23,597 INFO [Listener at jenkins-hbase4.apache.org/36385] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44645_node____.19ddl7/webapp 2023-09-13 21:00:23,648 INFO [Listener at jenkins-hbase4.apache.org/36385] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-13 21:00:23,648 INFO [Listener at jenkins-hbase4.apache.org/36385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-13 21:00:23,648 INFO [Listener at jenkins-hbase4.apache.org/36385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-13 21:00:23,649 INFO [Listener at jenkins-hbase4.apache.org/36385] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-13 21:00:23,657 INFO [Listener at jenkins-hbase4.apache.org/36385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 21:00:23,671 INFO [Listener at jenkins-hbase4.apache.org/36385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 21:00:23,738 INFO [Listener at jenkins-hbase4.apache.org/36385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 21:00:23,744 INFO [Listener at jenkins-hbase4.apache.org/36385] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44645 2023-09-13 21:00:23,770 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-13 21:00:23,771 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 21:00:23,826 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 21:00:23,836 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=143, ProcessCount=168, AvailableMemoryMB=9666 2023-09-13 21:00:23,837 WARN [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-09-13 21:00:23,866 DEBUG [Listener at jenkins-hbase4.apache.org/36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-13 21:00:23,873 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-13 21:00:23,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 21:00:23,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-13 21:00:23,896 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 21:00:23,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-13 21:00:23,902 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 21:00:23,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 21:00:23,908 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7 2023-09-13 21:00:23,908 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9 2023-09-13 21:00:23,909 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9 empty. 2023-09-13 21:00:23,909 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7 empty. 2023-09-13 21:00:23,910 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9 2023-09-13 21:00:23,912 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7 2023-09-13 21:00:23,912 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-13 21:00:23,963 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-13 21:00:23,968 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => c364193444d23fef61e0062b10ab9ee7, NAME => 'testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:00:23,968 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 33f915e269712eda4038c2d3b7e9d4c9, NAME => 'testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:00:24,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 21:00:24,022 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-13 21:00:24,027 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-13 21:00:24,027 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:24,027 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing c364193444d23fef61e0062b10ab9ee7, disabling compactions & flushes 2023-09-13 21:00:24,027 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:24,027 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:24,027 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. after waiting 0 ms 2023-09-13 21:00:24,027 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:24,027 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:24,028 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for c364193444d23fef61e0062b10ab9ee7: 2023-09-13 21:00:24,028 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:24,028 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 33f915e269712eda4038c2d3b7e9d4c9, disabling compactions & flushes 2023-09-13 21:00:24,028 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-13 21:00:24,028 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:24,028 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:24,028 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. after waiting 0 ms 2023-09-13 21:00:24,028 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:24,028 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:24,028 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 33f915e269712eda4038c2d3b7e9d4c9: 2023-09-13 21:00:24,035 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 21:00:24,037 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694638824037"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638824037"}]},"ts":"1694638824037"} 2023-09-13 21:00:24,037 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694638824037"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638824037"}]},"ts":"1694638824037"} 2023-09-13 21:00:24,086 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 21:00:24,087 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 21:00:24,088 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638824087"}]},"ts":"1694638824087"} 2023-09-13 21:00:24,090 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-13 21:00:24,095 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 21:00:24,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 21:00:24,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 21:00:24,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 21:00:24,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 21:00:24,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c364193444d23fef61e0062b10ab9ee7, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=33f915e269712eda4038c2d3b7e9d4c9, ASSIGN}] 2023-09-13 21:00:24,100 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=33f915e269712eda4038c2d3b7e9d4c9, ASSIGN 2023-09-13 21:00:24,100 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c364193444d23fef61e0062b10ab9ee7, ASSIGN 2023-09-13 21:00:24,101 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c364193444d23fef61e0062b10ab9ee7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42107,1694638816311; forceNewPlan=false, retain=false 2023-09-13 21:00:24,101 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=33f915e269712eda4038c2d3b7e9d4c9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43255,1694638816358; forceNewPlan=false, retain=false 2023-09-13 21:00:24,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 21:00:24,252 INFO [jenkins-hbase4:33631] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 21:00:24,254 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=33f915e269712eda4038c2d3b7e9d4c9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:24,254 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c364193444d23fef61e0062b10ab9ee7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:24,254 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694638824254"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638824254"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638824254"}]},"ts":"1694638824254"} 2023-09-13 21:00:24,255 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694638824254"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638824254"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638824254"}]},"ts":"1694638824254"} 2023-09-13 21:00:24,257 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 33f915e269712eda4038c2d3b7e9d4c9, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:00:24,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure c364193444d23fef61e0062b10ab9ee7, server=jenkins-hbase4.apache.org,42107,1694638816311}] 2023-09-13 21:00:24,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:24,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 33f915e269712eda4038c2d3b7e9d4c9, NAME => 'testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 21:00:24,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:24,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c364193444d23fef61e0062b10ab9ee7, NAME => 'testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 21:00:24,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. service=AccessControlService 2023-09-13 21:00:24,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. service=AccessControlService 2023-09-13 21:00:24,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:00:24,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:00:24,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 33f915e269712eda4038c2d3b7e9d4c9 2023-09-13 21:00:24,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName c364193444d23fef61e0062b10ab9ee7 2023-09-13 21:00:24,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:24,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:24,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 33f915e269712eda4038c2d3b7e9d4c9 2023-09-13 21:00:24,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 33f915e269712eda4038c2d3b7e9d4c9 2023-09-13 21:00:24,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c364193444d23fef61e0062b10ab9ee7 2023-09-13 21:00:24,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c364193444d23fef61e0062b10ab9ee7 2023-09-13 21:00:24,422 INFO [StoreOpener-33f915e269712eda4038c2d3b7e9d4c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 33f915e269712eda4038c2d3b7e9d4c9 2023-09-13 21:00:24,422 INFO [StoreOpener-c364193444d23fef61e0062b10ab9ee7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c364193444d23fef61e0062b10ab9ee7 2023-09-13 21:00:24,424 DEBUG [StoreOpener-33f915e269712eda4038c2d3b7e9d4c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/cf 2023-09-13 21:00:24,424 DEBUG [StoreOpener-33f915e269712eda4038c2d3b7e9d4c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/cf 2023-09-13 21:00:24,424 DEBUG [StoreOpener-c364193444d23fef61e0062b10ab9ee7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/cf 2023-09-13 21:00:24,424 DEBUG [StoreOpener-c364193444d23fef61e0062b10ab9ee7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/cf 2023-09-13 21:00:24,428 INFO [StoreOpener-33f915e269712eda4038c2d3b7e9d4c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33f915e269712eda4038c2d3b7e9d4c9 columnFamilyName cf 2023-09-13 21:00:24,428 INFO [StoreOpener-c364193444d23fef61e0062b10ab9ee7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c364193444d23fef61e0062b10ab9ee7 columnFamilyName cf 2023-09-13 21:00:24,431 INFO [StoreOpener-33f915e269712eda4038c2d3b7e9d4c9-1] regionserver.HStore(310): Store=33f915e269712eda4038c2d3b7e9d4c9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:24,433 INFO [StoreOpener-c364193444d23fef61e0062b10ab9ee7-1] regionserver.HStore(310): Store=c364193444d23fef61e0062b10ab9ee7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:24,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7 2023-09-13 21:00:24,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9 2023-09-13 21:00:24,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9 2023-09-13 21:00:24,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7 2023-09-13 21:00:24,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 33f915e269712eda4038c2d3b7e9d4c9 2023-09-13 21:00:24,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c364193444d23fef61e0062b10ab9ee7 2023-09-13 21:00:24,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:00:24,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c364193444d23fef61e0062b10ab9ee7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62180904, jitterRate=-0.0734323263168335}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:00:24,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c364193444d23fef61e0062b10ab9ee7: 2023-09-13 21:00:24,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:00:24,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 33f915e269712eda4038c2d3b7e9d4c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72151059, jitterRate=0.07513456046581268}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:00:24,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7., pid=16, masterSystemTime=1694638824411 2023-09-13 21:00:24,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 33f915e269712eda4038c2d3b7e9d4c9: 2023-09-13 21:00:24,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9., pid=15, masterSystemTime=1694638824410 2023-09-13 21:00:24,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:24,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:24,474 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c364193444d23fef61e0062b10ab9ee7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:24,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:24,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:24,474 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694638824473"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638824473"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638824473"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638824473"}]},"ts":"1694638824473"} 2023-09-13 21:00:24,475 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=33f915e269712eda4038c2d3b7e9d4c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:24,475 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694638824475"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638824475"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638824475"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638824475"}]},"ts":"1694638824475"} 2023-09-13 21:00:24,480 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-13 21:00:24,481 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure c364193444d23fef61e0062b10ab9ee7, server=jenkins-hbase4.apache.org,42107,1694638816311 in 218 msec 2023-09-13 21:00:24,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-13 21:00:24,485 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 33f915e269712eda4038c2d3b7e9d4c9, server=jenkins-hbase4.apache.org,43255,1694638816358 in 221 msec 2023-09-13 21:00:24,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c364193444d23fef61e0062b10ab9ee7, ASSIGN in 384 msec 2023-09-13 21:00:24,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-13 21:00:24,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=33f915e269712eda4038c2d3b7e9d4c9, ASSIGN in 388 msec 2023-09-13 21:00:24,490 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 21:00:24,490 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638824490"}]},"ts":"1694638824490"} 2023-09-13 21:00:24,492 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-13 21:00:24,496 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 21:00:24,501 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-13 21:00:24,506 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:24,508 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:24,512 DEBUG [hconnection-0x60b92418-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:24,515 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-09-13 21:00:24,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 21:00:24,523 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-13 21:00:24,555 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:24,555 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:24,555 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:24,555 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:24,555 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 21:00:24,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-13 21:00:24,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-13 21:00:24,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-13 21:00:24,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-13 21:00:24,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 681 msec 2023-09-13 21:00:25,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 21:00:25,018 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-13 21:00:25,021 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-13 21:00:25,023 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:25,025 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 21:00:25,048 DEBUG [hconnection-0x3ca857b3-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:25,051 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:25,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 21:00:25,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694638825067 (current time:1694638825067). 2023-09-13 21:00:25,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 21:00:25,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x58535d52 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:25,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@660c83a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:25,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:25,079 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:25,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58535d52 to 127.0.0.1:61376 2023-09-13 21:00:25,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:00:25,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x5626111e to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:25,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73d4effe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:25,090 DEBUG [hconnection-0x1204d7fc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:25,091 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:25,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:25,096 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:25,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5626111e to 127.0.0.1:61376 2023-09-13 21:00:25,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:00:25,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-13 21:00:25,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 21:00:25,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 21:00:25,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 21:00:25,140 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 21:00:25,142 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694639425141 2023-09-13 21:00:25,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 21:00:25,142 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-13 21:00:25,144 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 21:00:25,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 21:00:25,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 12 msec 2023-09-13 21:00:25,147 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 21:00:25,148 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694639425148 2023-09-13 21:00:25,149 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 21:00:25,150 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 21:00:25,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,177 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-13 21:00:25,177 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:25,178 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-13 21:00:25,178 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-13 21:00:25,178 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,178 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,185 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:25,185 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,185 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:25,185 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:25,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:25,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:25,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:25,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:25,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:25,185 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:25,185 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,186 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,186 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 21:00:25,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-13 21:00:25,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-13 21:00:25,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-13 21:00:25,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,187 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 21:00:25,187 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 21:00:25,188 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 21:00:25,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,193 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 21:00:25,193 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 21:00:25,193 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 21:00:25,193 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:25,193 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:25,194 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 21:00:25,195 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 21:00:25,195 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-13 21:00:25,195 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-13 21:00:25,195 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-13 21:00:25,193 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:25,195 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-13 21:00:25,196 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 21:00:25,196 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-13 21:00:25,196 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-13 21:00:25,198 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,198 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:25,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:25,199 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,199 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,199 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,199 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:25,199 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:25,199 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,200 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:25,200 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,200 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:25,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:25,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-13 21:00:25,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63026382[Count = 1] remaining members to acquire global barrier 2023-09-13 21:00:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:25,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-13 21:00:25,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63026382[Count = 0] remaining members to acquire global barrier 2023-09-13 21:00:25,206 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-13 21:00:25,206 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,208 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,208 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,208 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,208 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 21:00:25,208 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,208 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 21:00:25,209 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 21:00:25,209 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-13 21:00:25,209 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44809,1694638816394' in zk 2023-09-13 21:00:25,209 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,209 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 21:00:25,209 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:00:25,209 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:00:25,209 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:25,210 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. started... 2023-09-13 21:00:25,212 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c364193444d23fef61e0062b10ab9ee7: 2023-09-13 21:00:25,213 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,215 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:00:25,215 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:00:25,215 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:25,215 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. started... 2023-09-13 21:00:25,215 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 21:00:25,215 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:25,216 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 33f915e269712eda4038c2d3b7e9d4c9: 2023-09-13 21:00:25,216 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-13 21:00:25,217 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,223 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:00:25,223 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:00:25,226 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 21:00:25,226 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 21:00:25,236 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:00:25,237 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-13 21:00:25,238 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:00:25,238 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-13 21:00:25,238 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-13 21:00:25,238 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-13 21:00:25,238 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:00:25,238 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-13 21:00:25,239 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-13 21:00:25,239 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-13 21:00:25,250 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:00:25,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 21:00:25,259 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. completed. 2023-09-13 21:00:25,259 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:25,260 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:00:25,260 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:00:25,260 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,260 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-13 21:00:25,260 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42107,1694638816311' in zk 2023-09-13 21:00:25,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-13 21:00:25,261 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 21:00:25,262 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,262 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 21:00:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:25,262 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:25,263 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-13 21:00:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:25,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:25,264 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. completed. 2023-09-13 21:00:25,264 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:25,264 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:00:25,264 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:00:25,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:25,264 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,265 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-13 21:00:25,265 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43255,1694638816358' in zk 2023-09-13 21:00:25,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,268 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,268 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 21:00:25,268 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:25,268 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-13 21:00:25,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:25,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42107,1694638816311': 2023-09-13 21:00:25,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-13 21:00:25,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:25,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:25,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:25,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:25,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:25,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43255,1694638816358': 2023-09-13 21:00:25,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-13 21:00:25,278 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-13 21:00:25,278 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 21:00:25,278 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 21:00:25,278 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,278 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 21:00:25,280 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,280 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:25,281 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:25,281 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,281 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,281 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,281 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:25,282 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:25,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:25,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,282 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:25,283 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,286 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:25,286 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,287 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:25,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:25,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:25,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:25,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:25,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:25,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:25,299 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:25,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:25,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:25,300 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:25,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,299 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:25,300 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-13 21:00:25,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:25,300 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:25,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 21:00:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:25,300 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,301 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,301 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,301 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,301 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,301 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,301 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,301 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:25,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:25,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 21:00:25,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,372 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-13 21:00:25,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,373 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:25,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694638825142Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694638825322 (+180 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1694638825322Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1694638825322Writing data manifest for emptySnaptb0-testExportWithTargetName at 1694638825334 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1694638825358 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694638825372 (+14 ms) 2023-09-13 21:00:25,375 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 21:00:25,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 231 msec 2023-09-13 21:00:25,461 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:00:25,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 21:00:25,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 21:00:25,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42107] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 21:00:25,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43255] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 21:00:25,484 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-13 21:00:25,484 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:25,484 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 21:00:25,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 21:00:25,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694638825499 (current time:1694638825499). 2023-09-13 21:00:25,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 21:00:25,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x2ca4665d to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:25,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66565527, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:25,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:25,512 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:25,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ca4665d to 127.0.0.1:61376 2023-09-13 21:00:25,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:00:25,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x45da473a to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:25,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a434752, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:25,521 DEBUG [hconnection-0x1e68cc50-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:25,523 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:25,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:25,529 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:25,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45da473a to 127.0.0.1:61376 2023-09-13 21:00:25,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:00:25,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-13 21:00:25,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 21:00:25,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 21:00:25,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 21:00:25,535 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 21:00:25,537 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694639425537 2023-09-13 21:00:25,537 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-13 21:00:25,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 21:00:25,539 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 21:00:25,539 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 21:00:25,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 21:00:25,540 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 21:00:25,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-13 21:00:25,543 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 21:00:25,544 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694639425544 2023-09-13 21:00:25,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-13 21:00:25,561 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-13 21:00:25,561 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:25,562 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-13 21:00:25,562 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-13 21:00:25,563 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,563 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,564 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:25,564 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:25,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:25,564 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,564 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:25,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:25,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:25,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:25,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:25,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:25,565 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,565 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,565 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,565 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 21:00:25,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-13 21:00:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-13 21:00:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,566 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 21:00:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-13 21:00:25,566 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 21:00:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-13 21:00:25,567 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 21:00:25,567 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 21:00:25,567 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:25,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-13 21:00:25,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-13 21:00:25,568 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 21:00:25,568 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 21:00:25,568 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 21:00:25,568 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:25,568 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-13 21:00:25,569 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 21:00:25,569 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-13 21:00:25,568 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:25,569 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-13 21:00:25,570 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 21:00:25,570 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-13 21:00:25,569 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-13 21:00:25,570 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-13 21:00:25,573 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,573 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,573 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,573 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,573 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:25,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:25,573 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,574 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:25,573 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,574 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,574 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:25,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:25,574 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:25,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:25,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 21:00:25,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:25,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-13 21:00:25,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25c89cc7[Count = 1] remaining members to acquire global barrier 2023-09-13 21:00:25,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:25,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:25,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:25,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:25,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 21:00:25,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:25,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-13 21:00:25,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25c89cc7[Count = 0] remaining members to acquire global barrier 2023-09-13 21:00:25,579 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-13 21:00:25,579 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,584 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,584 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,584 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,584 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 21:00:25,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,584 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,584 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:00:25,585 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 21:00:25,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,585 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-13 21:00:25,585 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:25,585 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,585 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. started... 2023-09-13 21:00:25,585 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:00:25,585 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 21:00:25,585 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44809,1694638816394' in zk 2023-09-13 21:00:25,585 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 21:00:25,585 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c364193444d23fef61e0062b10ab9ee7 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-13 21:00:25,585 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:00:25,585 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:00:25,585 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:25,585 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. started... 2023-09-13 21:00:25,586 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 33f915e269712eda4038c2d3b7e9d4c9 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-13 21:00:25,588 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 21:00:25,588 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:25,588 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-13 21:00:25,639 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:00:25,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 21:00:25,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-13 21:00:25,641 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 21:00:25,726 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309133fe04eb38e80418b9af4d8a51544352e to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309133fe04eb38e80418b9af4d8a51544352e 2023-09-13 21:00:25,726 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091307efaf04e5174c84bea5d1ab2a9f8dde to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091307efaf04e5174c84bea5d1ab2a9f8dde 2023-09-13 21:00:25,765 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/.tmp/cf/60da46992c2c4241827f1360188e3d7f 2023-09-13 21:00:25,766 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/.tmp/cf/4daefafcf66b48ec8d7404754cb13ecd 2023-09-13 21:00:25,776 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/.tmp/cf/60da46992c2c4241827f1360188e3d7f as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/cf/60da46992c2c4241827f1360188e3d7f 2023-09-13 21:00:25,776 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/.tmp/cf/4daefafcf66b48ec8d7404754cb13ecd as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/cf/4daefafcf66b48ec8d7404754cb13ecd 2023-09-13 21:00:25,789 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/cf/60da46992c2c4241827f1360188e3d7f, entries=47, sequenceid=6, filesize=12.8 K 2023-09-13 21:00:25,790 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/cf/4daefafcf66b48ec8d7404754cb13ecd, entries=3, sequenceid=6, filesize=5.4 K 2023-09-13 21:00:25,794 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 33f915e269712eda4038c2d3b7e9d4c9 in 207ms, sequenceid=6, compaction requested=false 2023-09-13 21:00:25,794 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for c364193444d23fef61e0062b10ab9ee7 in 209ms, sequenceid=6, compaction requested=false 2023-09-13 21:00:25,794 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-13 21:00:25,794 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-13 21:00:25,796 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c364193444d23fef61e0062b10ab9ee7: 2023-09-13 21:00:25,796 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 33f915e269712eda4038c2d3b7e9d4c9: 2023-09-13 21:00:25,797 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-13 21:00:25,797 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-13 21:00:25,797 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:00:25,797 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:00:25,797 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/cf/60da46992c2c4241827f1360188e3d7f] hfiles 2023-09-13 21:00:25,797 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/cf/4daefafcf66b48ec8d7404754cb13ecd] hfiles 2023-09-13 21:00:25,797 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/cf/60da46992c2c4241827f1360188e3d7f for snapshot=snaptb0-testExportWithTargetName 2023-09-13 21:00:25,797 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/cf/4daefafcf66b48ec8d7404754cb13ecd for snapshot=snaptb0-testExportWithTargetName 2023-09-13 21:00:25,821 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. completed. 2023-09-13 21:00:25,821 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. completed. 2023-09-13 21:00:25,821 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:25,821 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:25,821 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:00:25,821 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:00:25,821 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:00:25,821 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:00:25,821 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,821 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,821 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-13 21:00:25,822 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-13 21:00:25,822 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42107,1694638816311' in zk 2023-09-13 21:00:25,822 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43255,1694638816358' in zk 2023-09-13 21:00:25,824 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 21:00:25,824 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,824 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 21:00:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,824 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:25,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:25,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:25,824 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:25,824 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,826 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-13 21:00:25,825 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-13 21:00:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 21:00:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 21:00:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42107,1694638816311': 2023-09-13 21:00:25,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-13 21:00:25,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:25,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:25,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:25,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:25,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 21:00:25,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:25,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 21:00:25,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43255,1694638816358': 2023-09-13 21:00:25,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-13 21:00:25,835 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-13 21:00:25,835 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 21:00:25,835 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 21:00:25,835 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-13 21:00:25,835 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 21:00:25,837 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,837 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:25,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:25,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,837 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:25,837 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,837 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,838 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:25,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,838 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:25,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:25,838 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:25,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:25,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:25,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:25,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:25,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:25,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 21:00:25,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,839 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:25,839 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 21:00:25,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,841 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:00:25,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:25,841 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 21:00:25,842 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,842 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 21:00:25,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-13 21:00:25,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,843 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-13 21:00:25,854 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,854 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,854 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,855 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:25,855 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:25,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:25,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:25,855 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:25,855 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:25,855 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:25,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:25,855 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:25,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-13 21:00:25,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-13 21:00:25,855 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,856 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:25,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:25,855 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:25,856 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:25,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:25,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-13 21:00:25,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:25,856 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 21:00:25,857 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:25,857 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:25,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:25,857 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,858 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091307efaf04e5174c84bea5d1ab2a9f8dde, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309133fe04eb38e80418b9af4d8a51544352e] mob files 2023-09-13 21:00:25,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091307efaf04e5174c84bea5d1ab2a9f8dde 2023-09-13 21:00:25,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309133fe04eb38e80418b9af4d8a51544352e 2023-09-13 21:00:25,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-13 21:00:25,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-13 21:00:25,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,908 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-13 21:00:25,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694638825537Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694638825873 (+336 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1694638825873Loading Region manifests for snaptb0-testExportWithTargetName at 1694638825873Writing data manifest for snaptb0-testExportWithTargetName at 1694638825878 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1694638825896 (+18 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694638825908 (+12 ms) 2023-09-13 21:00:25,910 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 21:00:25,913 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 373 msec 2023-09-13 21:00:26,143 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:00:26,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 21:00:26,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 21:00:26,147 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638826147 2023-09-13 21:00:26,148 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45325, tgtDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638826147, rawTgtDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638826147, srcFsUri=hdfs://localhost:45325, srcDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:00:26,193 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:00:26,193 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1325673081_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638826147, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638826147/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-13 21:00:26,193 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19, snapshotDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-13 21:00:26,211 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638826147/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-13 21:00:26,284 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:26,285 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:26,285 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:26,286 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:27,220 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-2580013101753734880.jar 2023-09-13 21:00:27,221 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:27,221 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:27,290 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-2179158693562814235.jar 2023-09-13 21:00:27,290 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:27,291 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:27,291 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:27,292 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:27,292 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:27,293 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:27,294 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 21:00:27,294 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 21:00:27,295 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 21:00:27,296 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 21:00:27,296 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 21:00:27,297 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 21:00:27,298 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 21:00:27,298 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 21:00:27,299 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 21:00:27,300 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 21:00:27,305 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:00:27,306 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:00:27,306 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:00:27,307 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:00:27,307 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:00:27,308 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:00:27,309 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:00:28,116 WARN [Listener at jenkins-hbase4.apache.org/36385] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 21:00:28,122 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-13 21:00:28,133 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-13 21:00:28,632 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:00:28,634 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:00:28,922 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0001_000001 (auth:SIMPLE) 2023-09-13 21:00:29,925 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 21:00:33,152 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0001_000001 (auth:SIMPLE) 2023-09-13 21:00:35,426 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0001_000001 (auth:SIMPLE) 2023-09-13 21:00:38,729 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0001_000001 (auth:SIMPLE) 2023-09-13 21:00:40,033 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 21:00:40,037 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 21:00:40,048 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-13 21:00:40,048 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 21:00:40,048 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 21:00:40,049 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1883159808_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-13 21:00:40,049 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-13 21:00:40,049 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-13 21:00:40,049 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1883159808_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638826147/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638826147/.hbase-snapshot/testExportWithTargetName 2023-09-13 21:00:40,050 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638826147/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-13 21:00:40,050 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638826147/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-13 21:00:40,061 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-13 21:00:40,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-13 21:00:40,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-13 21:00:40,081 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638840081"}]},"ts":"1694638840081"} 2023-09-13 21:00:40,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-13 21:00:40,083 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-13 21:00:40,085 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-13 21:00:40,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c364193444d23fef61e0062b10ab9ee7, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=33f915e269712eda4038c2d3b7e9d4c9, UNASSIGN}] 2023-09-13 21:00:40,089 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c364193444d23fef61e0062b10ab9ee7, UNASSIGN 2023-09-13 21:00:40,089 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=33f915e269712eda4038c2d3b7e9d4c9, UNASSIGN 2023-09-13 21:00:40,091 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=c364193444d23fef61e0062b10ab9ee7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:40,091 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=33f915e269712eda4038c2d3b7e9d4c9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:40,091 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694638840090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638840090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638840090"}]},"ts":"1694638840090"} 2023-09-13 21:00:40,091 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694638840090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638840090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638840090"}]},"ts":"1694638840090"} 2023-09-13 21:00:40,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure c364193444d23fef61e0062b10ab9ee7, server=jenkins-hbase4.apache.org,42107,1694638816311}] 2023-09-13 21:00:40,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 33f915e269712eda4038c2d3b7e9d4c9, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:00:40,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-13 21:00:40,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c364193444d23fef61e0062b10ab9ee7 2023-09-13 21:00:40,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 33f915e269712eda4038c2d3b7e9d4c9 2023-09-13 21:00:40,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c364193444d23fef61e0062b10ab9ee7, disabling compactions & flushes 2023-09-13 21:00:40,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 33f915e269712eda4038c2d3b7e9d4c9, disabling compactions & flushes 2023-09-13 21:00:40,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:40,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:40,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:40,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:40,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. after waiting 0 ms 2023-09-13 21:00:40,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. after waiting 0 ms 2023-09-13 21:00:40,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:40,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:40,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 21:00:40,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 21:00:40,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:00:40,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:00:40,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9. 2023-09-13 21:00:40,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7. 2023-09-13 21:00:40,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 33f915e269712eda4038c2d3b7e9d4c9: 2023-09-13 21:00:40,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c364193444d23fef61e0062b10ab9ee7: 2023-09-13 21:00:40,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 33f915e269712eda4038c2d3b7e9d4c9 2023-09-13 21:00:40,276 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=33f915e269712eda4038c2d3b7e9d4c9, regionState=CLOSED 2023-09-13 21:00:40,277 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694638840276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638840276"}]},"ts":"1694638840276"} 2023-09-13 21:00:40,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c364193444d23fef61e0062b10ab9ee7 2023-09-13 21:00:40,277 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=c364193444d23fef61e0062b10ab9ee7, regionState=CLOSED 2023-09-13 21:00:40,277 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694638840277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638840277"}]},"ts":"1694638840277"} 2023-09-13 21:00:40,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-13 21:00:40,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 33f915e269712eda4038c2d3b7e9d4c9, server=jenkins-hbase4.apache.org,43255,1694638816358 in 185 msec 2023-09-13 21:00:40,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-13 21:00:40,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure c364193444d23fef61e0062b10ab9ee7, server=jenkins-hbase4.apache.org,42107,1694638816311 in 186 msec 2023-09-13 21:00:40,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=33f915e269712eda4038c2d3b7e9d4c9, UNASSIGN in 195 msec 2023-09-13 21:00:40,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-13 21:00:40,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c364193444d23fef61e0062b10ab9ee7, UNASSIGN in 196 msec 2023-09-13 21:00:40,286 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638840286"}]},"ts":"1694638840286"} 2023-09-13 21:00:40,287 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-13 21:00:40,289 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-13 21:00:40,292 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 221 msec 2023-09-13 21:00:40,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-13 21:00:40,384 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-13 21:00:40,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-13 21:00:40,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 21:00:40,399 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 21:00:40,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-13 21:00:40,401 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 21:00:40,404 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-13 21:00:40,407 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7 2023-09-13 21:00:40,407 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9 2023-09-13 21:00:40,408 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 21:00:40,408 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 21:00:40,408 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 21:00:40,408 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 21:00:40,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-13 21:00:40,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-13 21:00:40,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-13 21:00:40,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-13 21:00:40,411 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 21:00:40,411 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:40,411 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 21:00:40,411 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 21:00:40,411 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/recovered.edits] 2023-09-13 21:00:40,411 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:40,411 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:40,411 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/recovered.edits] 2023-09-13 21:00:40,411 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 21:00:40,411 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:40,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-13 21:00:40,419 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/cf/4daefafcf66b48ec8d7404754cb13ecd to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/cf/4daefafcf66b48ec8d7404754cb13ecd 2023-09-13 21:00:40,419 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/cf/60da46992c2c4241827f1360188e3d7f to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/cf/60da46992c2c4241827f1360188e3d7f 2023-09-13 21:00:40,424 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/recovered.edits/9.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9/recovered.edits/9.seqid 2023-09-13 21:00:40,425 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/recovered.edits/9.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7/recovered.edits/9.seqid 2023-09-13 21:00:40,426 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/33f915e269712eda4038c2d3b7e9d4c9 2023-09-13 21:00:40,426 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportWithTargetName/c364193444d23fef61e0062b10ab9ee7 2023-09-13 21:00:40,426 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-13 21:00:40,427 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-13 21:00:40,428 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-13 21:00:40,432 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091307efaf04e5174c84bea5d1ab2a9f8dde to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023091307efaf04e5174c84bea5d1ab2a9f8dde 2023-09-13 21:00:40,433 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309133fe04eb38e80418b9af4d8a51544352e to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309133fe04eb38e80418b9af4d8a51544352e 2023-09-13 21:00:40,434 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-13 21:00:40,437 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 21:00:40,458 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-13 21:00:40,461 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-13 21:00:40,462 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 21:00:40,462 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-13 21:00:40,462 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694638840462"}]},"ts":"9223372036854775807"} 2023-09-13 21:00:40,463 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694638840462"}]},"ts":"9223372036854775807"} 2023-09-13 21:00:40,465 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 21:00:40,465 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c364193444d23fef61e0062b10ab9ee7, NAME => 'testtb-testExportWithTargetName,,1694638823885.c364193444d23fef61e0062b10ab9ee7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 33f915e269712eda4038c2d3b7e9d4c9, NAME => 'testtb-testExportWithTargetName,1,1694638823885.33f915e269712eda4038c2d3b7e9d4c9.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 21:00:40,465 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-13 21:00:40,465 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694638840465"}]},"ts":"9223372036854775807"} 2023-09-13 21:00:40,467 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-13 21:00:40,469 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 21:00:40,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 79 msec 2023-09-13 21:00:40,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-13 21:00:40,518 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-13 21:00:40,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-13 21:00:40,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-13 21:00:40,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-13 21:00:40,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-13 21:00:40,575 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=756 (was 704) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:42219 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:34345 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:36385 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_334110329_1 at /127.0.0.1:51380 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_334110329_1 at /127.0.0.1:42028 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1883159808_17 at /127.0.0.1:38370 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1883159808_17 at /127.0.0.1:42054 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:33201 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1883159808_17 at /127.0.0.1:51396 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=223 (was 143) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=8959 (was 9666) 2023-09-13 21:00:40,575 WARN [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-09-13 21:00:40,597 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=223, ProcessCount=170, AvailableMemoryMB=8958 2023-09-13 21:00:40,597 WARN [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-09-13 21:00:40,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 21:00:40,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-13 21:00:40,604 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 21:00:40,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-13 21:00:40,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-13 21:00:40,606 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 21:00:40,609 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb 2023-09-13 21:00:40,609 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76 2023-09-13 21:00:40,609 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb empty. 2023-09-13 21:00:40,609 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76 empty. 2023-09-13 21:00:40,610 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb 2023-09-13 21:00:40,610 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76 2023-09-13 21:00:40,610 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-13 21:00:40,623 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-13 21:00:40,626 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 237f8304774f16a36f23871a4790c8eb, NAME => 'testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:00:40,626 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8cc68012484b3036b61d596b93045f76, NAME => 'testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:00:40,654 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:40,655 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 237f8304774f16a36f23871a4790c8eb, disabling compactions & flushes 2023-09-13 21:00:40,655 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:40,655 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:40,655 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. after waiting 0 ms 2023-09-13 21:00:40,655 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:40,655 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:40,655 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 237f8304774f16a36f23871a4790c8eb: 2023-09-13 21:00:40,657 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:40,658 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8cc68012484b3036b61d596b93045f76, disabling compactions & flushes 2023-09-13 21:00:40,658 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:40,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:40,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. after waiting 0 ms 2023-09-13 21:00:40,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:40,659 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:40,659 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8cc68012484b3036b61d596b93045f76: 2023-09-13 21:00:40,661 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 21:00:40,663 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694638840662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638840662"}]},"ts":"1694638840662"} 2023-09-13 21:00:40,663 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694638840662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638840662"}]},"ts":"1694638840662"} 2023-09-13 21:00:40,665 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 21:00:40,666 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 21:00:40,667 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638840666"}]},"ts":"1694638840666"} 2023-09-13 21:00:40,668 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-13 21:00:40,673 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 21:00:40,674 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 21:00:40,674 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 21:00:40,674 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 21:00:40,674 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 21:00:40,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=237f8304774f16a36f23871a4790c8eb, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8cc68012484b3036b61d596b93045f76, ASSIGN}] 2023-09-13 21:00:40,677 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=237f8304774f16a36f23871a4790c8eb, ASSIGN 2023-09-13 21:00:40,677 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8cc68012484b3036b61d596b93045f76, ASSIGN 2023-09-13 21:00:40,678 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=237f8304774f16a36f23871a4790c8eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43255,1694638816358; forceNewPlan=false, retain=false 2023-09-13 21:00:40,678 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8cc68012484b3036b61d596b93045f76, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44809,1694638816394; forceNewPlan=false, retain=false 2023-09-13 21:00:40,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-13 21:00:40,828 INFO [jenkins-hbase4:33631] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 21:00:40,831 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8cc68012484b3036b61d596b93045f76, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:40,831 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=237f8304774f16a36f23871a4790c8eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:40,831 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694638840831"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638840831"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638840831"}]},"ts":"1694638840831"} 2023-09-13 21:00:40,831 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694638840831"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638840831"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638840831"}]},"ts":"1694638840831"} 2023-09-13 21:00:40,834 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 8cc68012484b3036b61d596b93045f76, server=jenkins-hbase4.apache.org,44809,1694638816394}] 2023-09-13 21:00:40,835 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 237f8304774f16a36f23871a4790c8eb, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:00:40,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-13 21:00:40,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:40,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 237f8304774f16a36f23871a4790c8eb, NAME => 'testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 21:00:40,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:40,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. service=AccessControlService 2023-09-13 21:00:40,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8cc68012484b3036b61d596b93045f76, NAME => 'testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 21:00:40,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:00:40,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 237f8304774f16a36f23871a4790c8eb 2023-09-13 21:00:40,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:40,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 237f8304774f16a36f23871a4790c8eb 2023-09-13 21:00:40,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. service=AccessControlService 2023-09-13 21:00:40,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 237f8304774f16a36f23871a4790c8eb 2023-09-13 21:00:40,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:00:40,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 8cc68012484b3036b61d596b93045f76 2023-09-13 21:00:40,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:40,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8cc68012484b3036b61d596b93045f76 2023-09-13 21:00:40,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8cc68012484b3036b61d596b93045f76 2023-09-13 21:00:40,998 INFO [StoreOpener-237f8304774f16a36f23871a4790c8eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 237f8304774f16a36f23871a4790c8eb 2023-09-13 21:00:40,998 INFO [StoreOpener-8cc68012484b3036b61d596b93045f76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8cc68012484b3036b61d596b93045f76 2023-09-13 21:00:40,999 DEBUG [StoreOpener-237f8304774f16a36f23871a4790c8eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/cf 2023-09-13 21:00:40,999 DEBUG [StoreOpener-237f8304774f16a36f23871a4790c8eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/cf 2023-09-13 21:00:40,999 DEBUG [StoreOpener-8cc68012484b3036b61d596b93045f76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/cf 2023-09-13 21:00:40,999 DEBUG [StoreOpener-8cc68012484b3036b61d596b93045f76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/cf 2023-09-13 21:00:41,000 INFO [StoreOpener-237f8304774f16a36f23871a4790c8eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 237f8304774f16a36f23871a4790c8eb columnFamilyName cf 2023-09-13 21:00:41,000 INFO [StoreOpener-8cc68012484b3036b61d596b93045f76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cc68012484b3036b61d596b93045f76 columnFamilyName cf 2023-09-13 21:00:41,001 INFO [StoreOpener-237f8304774f16a36f23871a4790c8eb-1] regionserver.HStore(310): Store=237f8304774f16a36f23871a4790c8eb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:41,002 INFO [StoreOpener-8cc68012484b3036b61d596b93045f76-1] regionserver.HStore(310): Store=8cc68012484b3036b61d596b93045f76/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:41,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb 2023-09-13 21:00:41,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76 2023-09-13 21:00:41,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb 2023-09-13 21:00:41,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76 2023-09-13 21:00:41,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 237f8304774f16a36f23871a4790c8eb 2023-09-13 21:00:41,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8cc68012484b3036b61d596b93045f76 2023-09-13 21:00:41,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:00:41,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 237f8304774f16a36f23871a4790c8eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72790733, jitterRate=0.08466644585132599}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:00:41,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 237f8304774f16a36f23871a4790c8eb: 2023-09-13 21:00:41,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb., pid=31, masterSystemTime=1694638840989 2023-09-13 21:00:41,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:00:41,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:41,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:41,015 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=237f8304774f16a36f23871a4790c8eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,015 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694638841015"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638841015"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638841015"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638841015"}]},"ts":"1694638841015"} 2023-09-13 21:00:41,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8cc68012484b3036b61d596b93045f76; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70513230, jitterRate=0.05072900652885437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:00:41,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8cc68012484b3036b61d596b93045f76: 2023-09-13 21:00:41,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76., pid=30, masterSystemTime=1694638840987 2023-09-13 21:00:41,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:41,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:41,021 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8cc68012484b3036b61d596b93045f76, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,023 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694638841021"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638841021"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638841021"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638841021"}]},"ts":"1694638841021"} 2023-09-13 21:00:41,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-13 21:00:41,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 237f8304774f16a36f23871a4790c8eb, server=jenkins-hbase4.apache.org,43255,1694638816358 in 182 msec 2023-09-13 21:00:41,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=237f8304774f16a36f23871a4790c8eb, ASSIGN in 350 msec 2023-09-13 21:00:41,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-13 21:00:41,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 8cc68012484b3036b61d596b93045f76, server=jenkins-hbase4.apache.org,44809,1694638816394 in 191 msec 2023-09-13 21:00:41,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-13 21:00:41,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8cc68012484b3036b61d596b93045f76, ASSIGN in 356 msec 2023-09-13 21:00:41,034 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 21:00:41,034 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638841034"}]},"ts":"1694638841034"} 2023-09-13 21:00:41,036 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-13 21:00:41,038 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 21:00:41,039 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-13 21:00:41,040 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 21:00:41,042 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:41,042 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:41,042 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:41,042 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:41,044 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 21:00:41,044 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 21:00:41,044 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 21:00:41,044 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 21:00:41,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 444 msec 2023-09-13 21:00:41,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-13 21:00:41,210 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-13 21:00:41,213 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-13 21:00:41,213 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:41,216 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 21:00:41,226 DEBUG [hconnection-0x3ca857b3-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:41,231 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:41,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 21:00:41,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694638841235 (current time:1694638841235). 2023-09-13 21:00:41,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 21:00:41,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x1fcdd3e8 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:41,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68eb26c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:41,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:41,244 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:41,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fcdd3e8 to 127.0.0.1:61376 2023-09-13 21:00:41,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:00:41,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x5e8e79d8 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:41,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f2db372, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:41,252 DEBUG [hconnection-0x1ec11d39-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:41,255 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:41,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:41,259 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:41,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e8e79d8 to 127.0.0.1:61376 2023-09-13 21:00:41,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:00:41,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 21:00:41,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 21:00:41,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 21:00:41,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 21:00:41,264 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 21:00:41,265 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694639441265 2023-09-13 21:00:41,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 21:00:41,265 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-13 21:00:41,266 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 21:00:41,266 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 21:00:41,268 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 21:00:41,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 21:00:41,269 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-13 21:00:41,270 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 21:00:41,271 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694639441271 2023-09-13 21:00:41,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,287 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-13 21:00:41,287 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:41,288 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-13 21:00:41,288 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-13 21:00:41,289 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,289 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,291 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:41,292 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:41,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:41,291 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:41,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:41,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:41,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:41,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:41,292 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:41,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,292 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,292 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,293 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-13 21:00:41,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,293 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 21:00:41,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-13 21:00:41,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,293 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 21:00:41,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-13 21:00:41,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,293 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 21:00:41,293 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 21:00:41,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,294 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 21:00:41,294 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:41,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,301 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 21:00:41,301 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:41,301 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 21:00:41,302 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 21:00:41,302 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-13 21:00:41,301 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 21:00:41,302 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-13 21:00:41,302 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-13 21:00:41,302 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:41,302 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-13 21:00:41,303 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 21:00:41,303 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-13 21:00:41,303 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-13 21:00:41,304 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,304 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:41,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:41,313 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:41,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:41,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:41,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-13 21:00:41,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6686eeba[Count = 1] remaining members to acquire global barrier 2023-09-13 21:00:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:41,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:41,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:41,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-13 21:00:41,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6686eeba[Count = 0] remaining members to acquire global barrier 2023-09-13 21:00:41,318 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-13 21:00:41,318 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,319 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,319 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,319 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,319 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 21:00:41,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,319 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,319 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 21:00:41,319 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 21:00:41,319 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-13 21:00:41,320 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42107,1694638816311' in zk 2023-09-13 21:00:41,320 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:00:41,320 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:00:41,320 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:00:41,320 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:41,320 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,320 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. started... 2023-09-13 21:00:41,320 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:41,320 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 21:00:41,320 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:00:41,320 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 237f8304774f16a36f23871a4790c8eb: 2023-09-13 21:00:41,320 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. started... 2023-09-13 21:00:41,320 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,321 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8cc68012484b3036b61d596b93045f76: 2023-09-13 21:00:41,321 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:00:41,321 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 21:00:41,321 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 21:00:41,321 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:41,321 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-13 21:00:41,321 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,322 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:00:41,322 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 21:00:41,340 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. completed. 2023-09-13 21:00:41,340 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:41,340 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:00:41,340 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:00:41,340 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,340 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-13 21:00:41,340 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43255,1694638816358' in zk 2023-09-13 21:00:41,341 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. completed. 2023-09-13 21:00:41,341 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:41,341 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:00:41,341 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:00:41,341 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,341 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-13 21:00:41,341 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44809,1694638816394' in zk 2023-09-13 21:00:41,342 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 21:00:41,342 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,342 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:41,342 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-13 21:00:41,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:41,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:41,344 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,344 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 21:00:41,344 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:41,344 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-13 21:00:41,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:41,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:41,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:41,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43255,1694638816358': 2023-09-13 21:00:41,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-13 21:00:41,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:41,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:41,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:41,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:41,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:41,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44809,1694638816394': 2023-09-13 21:00:41,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-13 21:00:41,353 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-13 21:00:41,353 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 21:00:41,353 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 21:00:41,353 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,353 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 21:00:41,355 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,355 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:41,355 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,356 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:41,355 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,356 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,355 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,356 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:41,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:41,357 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:41,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,357 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,360 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:41,360 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,360 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,364 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:41,364 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:41,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:41,364 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:41,364 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,364 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,364 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,364 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:41,364 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:41,364 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:41,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:41,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:41,364 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:41,364 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:41,366 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-13 21:00:41,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 21:00:41,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:41,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:41,364 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:41,366 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,367 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:00:41,367 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,367 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,367 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,367 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 21:00:41,367 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,367 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 21:00:41,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 21:00:41,368 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 21:00:41,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,418 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-13 21:00:41,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,419 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:41,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694638841265Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694638841392 (+127 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1694638841392Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1694638841392Writing data manifest for emptySnaptb0-testExportFileSystemState at 1694638841398 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1694638841411 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694638841418 (+7 ms) 2023-09-13 21:00:41,421 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 21:00:41,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 155 msec 2023-09-13 21:00:41,568 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:00:41,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 21:00:41,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 21:00:41,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43255] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 21:00:41,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44809] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 21:00:41,580 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-13 21:00:41,580 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:41,580 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 21:00:41,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 21:00:41,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694638841594 (current time:1694638841594). 2023-09-13 21:00:41,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 21:00:41,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x74b791bf to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:41,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79e622c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:41,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:41,607 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:41,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74b791bf to 127.0.0.1:61376 2023-09-13 21:00:41,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:00:41,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x1f7ea40f to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:41,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fb4041a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:41,616 DEBUG [hconnection-0x5f736ba1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:41,617 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:41,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:41,623 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:41,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f7ea40f to 127.0.0.1:61376 2023-09-13 21:00:41,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:00:41,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 21:00:41,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 21:00:41,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 21:00:41,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 21:00:41,629 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 21:00:41,630 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694639441630 2023-09-13 21:00:41,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 21:00:41,630 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-13 21:00:41,631 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 21:00:41,631 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 21:00:41,632 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 21:00:41,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 21:00:41,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-13 21:00:41,635 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 21:00:41,635 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694639441635 2023-09-13 21:00:41,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-13 21:00:41,648 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-13 21:00:41,648 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:41,650 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-13 21:00:41,650 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-13 21:00:41,651 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,651 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,652 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:41,652 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:41,652 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:41,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:41,653 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:41,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:41,653 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,653 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,654 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,654 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 21:00:41,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-13 21:00:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-13 21:00:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-13 21:00:41,655 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 21:00:41,655 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 21:00:41,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,655 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 21:00:41,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-13 21:00:41,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-13 21:00:41,669 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 21:00:41,669 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 21:00:41,669 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:41,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-13 21:00:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 21:00:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 21:00:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:41,669 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:41,672 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 21:00:41,673 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 21:00:41,673 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-13 21:00:41,673 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-13 21:00:41,673 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-13 21:00:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-13 21:00:41,673 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-13 21:00:41,674 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-13 21:00:41,676 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,676 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:41,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:41,677 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,677 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,677 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,677 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,677 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:41,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:41,678 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,678 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,678 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:41,678 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:41,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:41,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 21:00:41,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:41,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-13 21:00:41,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7496809[Count = 1] remaining members to acquire global barrier 2023-09-13 21:00:41,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:41,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:41,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:41,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:41,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 21:00:41,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:41,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-13 21:00:41,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7496809[Count = 0] remaining members to acquire global barrier 2023-09-13 21:00:41,683 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-13 21:00:41,683 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,684 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,684 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,684 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,684 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,684 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 21:00:41,685 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-13 21:00:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,685 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42107,1694638816311' in zk 2023-09-13 21:00:41,685 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 21:00:41,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,685 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,685 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 21:00:41,685 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:00:41,685 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:00:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,685 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:41,685 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. started... 2023-09-13 21:00:41,685 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 21:00:41,685 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 237f8304774f16a36f23871a4790c8eb 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-13 21:00:41,686 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 21:00:41,687 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:41,687 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-13 21:00:41,691 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:00:41,693 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:41,693 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:00:41,693 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. started... 2023-09-13 21:00:41,693 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8cc68012484b3036b61d596b93045f76 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-13 21:00:41,731 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:00:41,735 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230913632e84f66ee34df883f19895581c0791 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913632e84f66ee34df883f19895581c0791 2023-09-13 21:00:41,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 21:00:41,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 21:00:41,735 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309137491b377f39a489d81cdff08c50a87d7 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309137491b377f39a489d81cdff08c50a87d7 2023-09-13 21:00:41,735 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 21:00:41,749 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/.tmp/cf/1f740fcae5a8422c9d4645ca54b41bbc 2023-09-13 21:00:41,755 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/.tmp/cf/eb5b1327a5e34facab2d5cb12e9ef970 2023-09-13 21:00:41,758 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/.tmp/cf/1f740fcae5a8422c9d4645ca54b41bbc as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/cf/1f740fcae5a8422c9d4645ca54b41bbc 2023-09-13 21:00:41,761 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/.tmp/cf/eb5b1327a5e34facab2d5cb12e9ef970 as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/cf/eb5b1327a5e34facab2d5cb12e9ef970 2023-09-13 21:00:41,764 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/cf/1f740fcae5a8422c9d4645ca54b41bbc, entries=2, sequenceid=6, filesize=5.2 K 2023-09-13 21:00:41,765 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 237f8304774f16a36f23871a4790c8eb in 80ms, sequenceid=6, compaction requested=false 2023-09-13 21:00:41,765 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-13 21:00:41,766 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 237f8304774f16a36f23871a4790c8eb: 2023-09-13 21:00:41,766 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-13 21:00:41,766 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:00:41,766 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/cf/1f740fcae5a8422c9d4645ca54b41bbc] hfiles 2023-09-13 21:00:41,766 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/cf/1f740fcae5a8422c9d4645ca54b41bbc for snapshot=snaptb0-testExportFileSystemState 2023-09-13 21:00:41,768 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/cf/eb5b1327a5e34facab2d5cb12e9ef970, entries=48, sequenceid=6, filesize=13.0 K 2023-09-13 21:00:41,769 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 8cc68012484b3036b61d596b93045f76 in 75ms, sequenceid=6, compaction requested=false 2023-09-13 21:00:41,770 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8cc68012484b3036b61d596b93045f76: 2023-09-13 21:00:41,770 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-13 21:00:41,770 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:00:41,770 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/cf/eb5b1327a5e34facab2d5cb12e9ef970] hfiles 2023-09-13 21:00:41,770 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/cf/eb5b1327a5e34facab2d5cb12e9ef970 for snapshot=snaptb0-testExportFileSystemState 2023-09-13 21:00:41,779 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. completed. 2023-09-13 21:00:41,779 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:41,780 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:00:41,780 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:00:41,780 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,786 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-13 21:00:41,786 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43255,1694638816358' in zk 2023-09-13 21:00:41,793 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. completed. 2023-09-13 21:00:41,793 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:41,794 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:00:41,794 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:00:41,794 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,794 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-13 21:00:41,794 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44809,1694638816394' in zk 2023-09-13 21:00:41,794 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 21:00:41,794 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:41,794 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-13 21:00:41,796 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:41,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:41,797 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:41,797 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 21:00:41,797 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:41,797 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-13 21:00:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 21:00:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:41,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 21:00:41,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43255,1694638816358': 2023-09-13 21:00:41,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-13 21:00:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 21:00:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 21:00:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44809,1694638816394': 2023-09-13 21:00:41,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-13 21:00:41,805 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-13 21:00:41,805 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 21:00:41,805 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 21:00:41,805 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-13 21:00:41,806 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 21:00:41,807 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,807 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,807 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:41,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:41,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:41,807 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,807 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:41,807 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:41,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,808 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,808 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:41,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:41,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:41,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:41,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:41,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 21:00:41,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:41,809 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:41,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:41,809 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 21:00:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 21:00:41,811 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,812 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,814 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,817 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:41,817 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:41,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:41,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:41,817 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:41,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:41,817 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:41,817 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:41,817 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:41,817 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,818 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,818 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,818 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:41,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:41,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:41,817 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:41,818 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-13 21:00:41,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:41,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:41,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:41,818 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,820 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:41,820 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,820 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:41,820 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:41,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:41,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-13 21:00:41,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:41,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-13 21:00:41,820 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 21:00:41,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:41,820 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913632e84f66ee34df883f19895581c0791, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309137491b377f39a489d81cdff08c50a87d7] mob files 2023-09-13 21:00:41,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913632e84f66ee34df883f19895581c0791 2023-09-13 21:00:41,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309137491b377f39a489d81cdff08c50a87d7 2023-09-13 21:00:41,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-13 21:00:41,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,869 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-13 21:00:41,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,870 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694638841630Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694638841834 (+204 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1694638841834Loading Region manifests for snaptb0-testExportFileSystemState at 1694638841834Writing data manifest for snaptb0-testExportFileSystemState at 1694638841841 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1694638841857 (+16 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694638841869 (+12 ms) 2023-09-13 21:00:41,873 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 21:00:41,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 242 msec 2023-09-13 21:00:41,936 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:00:41,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 21:00:41,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 21:00:41,937 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638841937 2023-09-13 21:00:41,937 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45325, tgtDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638841937, rawTgtDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638841937, srcFsUri=hdfs://localhost:45325, srcDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:00:41,962 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:00:41,962 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-585389298_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638841937, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638841937/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 21:00:41,962 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19, snapshotDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-13 21:00:41,975 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638841937/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 21:00:42,004 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:42,004 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:42,005 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:42,005 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:42,907 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-4843950449116929056.jar 2023-09-13 21:00:42,907 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:42,908 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:42,980 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-6991797575835567236.jar 2023-09-13 21:00:42,980 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:42,981 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:42,981 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:42,981 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:42,982 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:42,982 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:42,983 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 21:00:42,983 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 21:00:42,983 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 21:00:42,984 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 21:00:42,984 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 21:00:42,985 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 21:00:42,985 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 21:00:42,985 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 21:00:42,985 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 21:00:42,986 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 21:00:42,987 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:00:42,987 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:00:42,988 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:00:42,988 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:00:42,988 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:00:42,989 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:00:42,989 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:00:43,455 WARN [Listener at jenkins-hbase4.apache.org/36385] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 21:00:43,459 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-13 21:00:43,461 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-13 21:00:44,936 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:00:44,936 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:00:44,943 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0001_000001 (auth:SIMPLE) 2023-09-13 21:00:45,732 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0002_000001 (auth:SIMPLE) 2023-09-13 21:00:45,886 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 21:00:49,801 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0002_000001 (auth:SIMPLE) 2023-09-13 21:00:52,034 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0002_000001 (auth:SIMPLE) 2023-09-13 21:00:55,199 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0002_000001 (auth:SIMPLE) 2023-09-13 21:00:56,655 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 21:00:56,656 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 21:00:56,664 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-13 21:00:56,664 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 21:00:56,665 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 21:00:56,665 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1883159808_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-13 21:00:56,665 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-13 21:00:56,666 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-13 21:00:56,666 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1883159808_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638841937/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638841937/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-13 21:00:56,666 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638841937/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-13 21:00:56,666 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638841937/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-13 21:00:56,674 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-13 21:00:56,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-13 21:00:56,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-13 21:00:56,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-13 21:00:56,680 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638856680"}]},"ts":"1694638856680"} 2023-09-13 21:00:56,682 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-13 21:00:56,684 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-13 21:00:56,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=237f8304774f16a36f23871a4790c8eb, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8cc68012484b3036b61d596b93045f76, UNASSIGN}] 2023-09-13 21:00:56,688 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=237f8304774f16a36f23871a4790c8eb, UNASSIGN 2023-09-13 21:00:56,688 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8cc68012484b3036b61d596b93045f76, UNASSIGN 2023-09-13 21:00:56,688 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=237f8304774f16a36f23871a4790c8eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:56,689 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8cc68012484b3036b61d596b93045f76, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:56,689 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694638856688"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638856688"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638856688"}]},"ts":"1694638856688"} 2023-09-13 21:00:56,689 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694638856689"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638856689"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638856689"}]},"ts":"1694638856689"} 2023-09-13 21:00:56,690 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 237f8304774f16a36f23871a4790c8eb, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:00:56,691 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 8cc68012484b3036b61d596b93045f76, server=jenkins-hbase4.apache.org,44809,1694638816394}] 2023-09-13 21:00:56,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-13 21:00:56,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 237f8304774f16a36f23871a4790c8eb 2023-09-13 21:00:56,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 237f8304774f16a36f23871a4790c8eb, disabling compactions & flushes 2023-09-13 21:00:56,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:56,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:56,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. after waiting 0 ms 2023-09-13 21:00:56,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:56,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8cc68012484b3036b61d596b93045f76 2023-09-13 21:00:56,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8cc68012484b3036b61d596b93045f76, disabling compactions & flushes 2023-09-13 21:00:56,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:56,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:56,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. after waiting 0 ms 2023-09-13 21:00:56,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:56,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 21:00:56,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:00:56,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb. 2023-09-13 21:00:56,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 21:00:56,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 237f8304774f16a36f23871a4790c8eb: 2023-09-13 21:00:56,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:00:56,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76. 2023-09-13 21:00:56,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8cc68012484b3036b61d596b93045f76: 2023-09-13 21:00:56,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 237f8304774f16a36f23871a4790c8eb 2023-09-13 21:00:56,858 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=237f8304774f16a36f23871a4790c8eb, regionState=CLOSED 2023-09-13 21:00:56,858 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694638856858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638856858"}]},"ts":"1694638856858"} 2023-09-13 21:00:56,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8cc68012484b3036b61d596b93045f76 2023-09-13 21:00:56,859 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8cc68012484b3036b61d596b93045f76, regionState=CLOSED 2023-09-13 21:00:56,859 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694638856859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638856859"}]},"ts":"1694638856859"} 2023-09-13 21:00:56,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-13 21:00:56,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 237f8304774f16a36f23871a4790c8eb, server=jenkins-hbase4.apache.org,43255,1694638816358 in 170 msec 2023-09-13 21:00:56,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-13 21:00:56,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 8cc68012484b3036b61d596b93045f76, server=jenkins-hbase4.apache.org,44809,1694638816394 in 170 msec 2023-09-13 21:00:56,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=237f8304774f16a36f23871a4790c8eb, UNASSIGN in 178 msec 2023-09-13 21:00:56,866 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-13 21:00:56,866 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8cc68012484b3036b61d596b93045f76, UNASSIGN in 179 msec 2023-09-13 21:00:56,867 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638856867"}]},"ts":"1694638856867"} 2023-09-13 21:00:56,869 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-13 21:00:56,871 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-13 21:00:56,873 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 196 msec 2023-09-13 21:00:56,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-13 21:00:56,982 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-13 21:00:56,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-13 21:00:56,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 21:00:56,987 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 21:00:56,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-13 21:00:56,988 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 21:00:56,990 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-13 21:00:56,992 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 21:00:56,992 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 21:00:56,992 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 21:00:56,992 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 21:00:56,993 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-13 21:00:56,993 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-13 21:00:56,993 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-13 21:00:56,993 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-13 21:00:56,994 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb 2023-09-13 21:00:56,994 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76 2023-09-13 21:00:56,996 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 21:00:56,996 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 21:00:56,996 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/recovered.edits] 2023-09-13 21:00:56,996 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:56,996 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 21:00:56,996 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:56,996 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 21:00:56,996 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:56,996 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:56,996 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/recovered.edits] 2023-09-13 21:00:56,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-13 21:00:57,002 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/cf/1f740fcae5a8422c9d4645ca54b41bbc to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/cf/1f740fcae5a8422c9d4645ca54b41bbc 2023-09-13 21:00:57,002 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/cf/eb5b1327a5e34facab2d5cb12e9ef970 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/cf/eb5b1327a5e34facab2d5cb12e9ef970 2023-09-13 21:00:57,005 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/recovered.edits/9.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb/recovered.edits/9.seqid 2023-09-13 21:00:57,006 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/recovered.edits/9.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76/recovered.edits/9.seqid 2023-09-13 21:00:57,006 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/237f8304774f16a36f23871a4790c8eb 2023-09-13 21:00:57,007 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemState/8cc68012484b3036b61d596b93045f76 2023-09-13 21:00:57,007 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-13 21:00:57,007 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-13 21:00:57,008 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-13 21:00:57,012 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913632e84f66ee34df883f19895581c0791 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913632e84f66ee34df883f19895581c0791 2023-09-13 21:00:57,014 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309137491b377f39a489d81cdff08c50a87d7 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309137491b377f39a489d81cdff08c50a87d7 2023-09-13 21:00:57,014 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-13 21:00:57,017 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 21:00:57,019 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-13 21:00:57,022 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-13 21:00:57,023 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 21:00:57,023 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-13 21:00:57,023 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694638857023"}]},"ts":"9223372036854775807"} 2023-09-13 21:00:57,023 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694638857023"}]},"ts":"9223372036854775807"} 2023-09-13 21:00:57,025 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 21:00:57,026 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 237f8304774f16a36f23871a4790c8eb, NAME => 'testtb-testExportFileSystemState,,1694638840599.237f8304774f16a36f23871a4790c8eb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8cc68012484b3036b61d596b93045f76, NAME => 'testtb-testExportFileSystemState,1,1694638840599.8cc68012484b3036b61d596b93045f76.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 21:00:57,026 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-13 21:00:57,026 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694638857026"}]},"ts":"9223372036854775807"} 2023-09-13 21:00:57,027 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-13 21:00:57,030 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 21:00:57,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 46 msec 2023-09-13 21:00:57,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-13 21:00:57,099 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-13 21:00:57,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-13 21:00:57,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-13 21:00:57,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-13 21:00:57,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-13 21:00:57,136 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=767 (was 756) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1883159808_17 at /127.0.0.1:46348 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2080 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:36171 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1883159808_17 at /127.0.0.1:47766 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-219281385_1 at /127.0.0.1:56686 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1883159808_17 at /127.0.0.1:40816 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=938 (was 935) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 223), ProcessCount=170 (was 170), AvailableMemoryMB=8704 (was 8958) 2023-09-13 21:00:57,136 WARN [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-13 21:00:57,154 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=938, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=170, AvailableMemoryMB=8704 2023-09-13 21:00:57,154 WARN [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-13 21:00:57,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 21:00:57,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-13 21:00:57,159 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 21:00:57,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-13 21:00:57,160 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 21:00:57,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-13 21:00:57,163 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0 2023-09-13 21:00:57,163 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b 2023-09-13 21:00:57,163 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0 empty. 2023-09-13 21:00:57,163 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b empty. 2023-09-13 21:00:57,164 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0 2023-09-13 21:00:57,164 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b 2023-09-13 21:00:57,164 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-13 21:00:57,176 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-13 21:00:57,178 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6caf643fb8e657911b093994ed979ca0, NAME => 'testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:00:57,178 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => f51221dc784c47259d0317027b3c947b, NAME => 'testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:00:57,186 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:57,186 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 6caf643fb8e657911b093994ed979ca0, disabling compactions & flushes 2023-09-13 21:00:57,186 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:00:57,186 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:00:57,186 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. after waiting 0 ms 2023-09-13 21:00:57,186 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:00:57,186 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:00:57,186 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:57,186 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 6caf643fb8e657911b093994ed979ca0: 2023-09-13 21:00:57,186 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing f51221dc784c47259d0317027b3c947b, disabling compactions & flushes 2023-09-13 21:00:57,186 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:00:57,187 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:00:57,187 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. after waiting 0 ms 2023-09-13 21:00:57,187 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:00:57,187 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:00:57,187 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for f51221dc784c47259d0317027b3c947b: 2023-09-13 21:00:57,189 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 21:00:57,190 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694638857190"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638857190"}]},"ts":"1694638857190"} 2023-09-13 21:00:57,190 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694638857190"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638857190"}]},"ts":"1694638857190"} 2023-09-13 21:00:57,192 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 21:00:57,193 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 21:00:57,193 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638857193"}]},"ts":"1694638857193"} 2023-09-13 21:00:57,195 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-13 21:00:57,198 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 21:00:57,199 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 21:00:57,199 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 21:00:57,199 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 21:00:57,199 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 21:00:57,199 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6caf643fb8e657911b093994ed979ca0, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f51221dc784c47259d0317027b3c947b, ASSIGN}] 2023-09-13 21:00:57,204 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f51221dc784c47259d0317027b3c947b, ASSIGN 2023-09-13 21:00:57,204 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6caf643fb8e657911b093994ed979ca0, ASSIGN 2023-09-13 21:00:57,205 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6caf643fb8e657911b093994ed979ca0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42107,1694638816311; forceNewPlan=false, retain=false 2023-09-13 21:00:57,205 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f51221dc784c47259d0317027b3c947b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43255,1694638816358; forceNewPlan=false, retain=false 2023-09-13 21:00:57,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-13 21:00:57,356 INFO [jenkins-hbase4:33631] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 21:00:57,358 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f51221dc784c47259d0317027b3c947b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,358 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6caf643fb8e657911b093994ed979ca0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,358 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694638857358"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638857358"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638857358"}]},"ts":"1694638857358"} 2023-09-13 21:00:57,358 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694638857358"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638857358"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638857358"}]},"ts":"1694638857358"} 2023-09-13 21:00:57,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure f51221dc784c47259d0317027b3c947b, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:00:57,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 6caf643fb8e657911b093994ed979ca0, server=jenkins-hbase4.apache.org,42107,1694638816311}] 2023-09-13 21:00:57,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-13 21:00:57,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:00:57,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f51221dc784c47259d0317027b3c947b, NAME => 'testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 21:00:57,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:00:57,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6caf643fb8e657911b093994ed979ca0, NAME => 'testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 21:00:57,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. service=AccessControlService 2023-09-13 21:00:57,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. service=AccessControlService 2023-09-13 21:00:57,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:00:57,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:00:57,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 6caf643fb8e657911b093994ed979ca0 2023-09-13 21:00:57,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports f51221dc784c47259d0317027b3c947b 2023-09-13 21:00:57,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:57,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:00:57,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6caf643fb8e657911b093994ed979ca0 2023-09-13 21:00:57,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6caf643fb8e657911b093994ed979ca0 2023-09-13 21:00:57,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f51221dc784c47259d0317027b3c947b 2023-09-13 21:00:57,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f51221dc784c47259d0317027b3c947b 2023-09-13 21:00:57,518 INFO [StoreOpener-6caf643fb8e657911b093994ed979ca0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6caf643fb8e657911b093994ed979ca0 2023-09-13 21:00:57,518 INFO [StoreOpener-f51221dc784c47259d0317027b3c947b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f51221dc784c47259d0317027b3c947b 2023-09-13 21:00:57,519 DEBUG [StoreOpener-6caf643fb8e657911b093994ed979ca0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/cf 2023-09-13 21:00:57,520 DEBUG [StoreOpener-6caf643fb8e657911b093994ed979ca0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/cf 2023-09-13 21:00:57,520 DEBUG [StoreOpener-f51221dc784c47259d0317027b3c947b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/cf 2023-09-13 21:00:57,520 DEBUG [StoreOpener-f51221dc784c47259d0317027b3c947b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/cf 2023-09-13 21:00:57,520 INFO [StoreOpener-6caf643fb8e657911b093994ed979ca0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6caf643fb8e657911b093994ed979ca0 columnFamilyName cf 2023-09-13 21:00:57,520 INFO [StoreOpener-f51221dc784c47259d0317027b3c947b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f51221dc784c47259d0317027b3c947b columnFamilyName cf 2023-09-13 21:00:57,521 INFO [StoreOpener-6caf643fb8e657911b093994ed979ca0-1] regionserver.HStore(310): Store=6caf643fb8e657911b093994ed979ca0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:57,521 INFO [StoreOpener-f51221dc784c47259d0317027b3c947b-1] regionserver.HStore(310): Store=f51221dc784c47259d0317027b3c947b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:00:57,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b 2023-09-13 21:00:57,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0 2023-09-13 21:00:57,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0 2023-09-13 21:00:57,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b 2023-09-13 21:00:57,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6caf643fb8e657911b093994ed979ca0 2023-09-13 21:00:57,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f51221dc784c47259d0317027b3c947b 2023-09-13 21:00:57,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:00:57,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:00:57,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6caf643fb8e657911b093994ed979ca0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68321702, jitterRate=0.018072694540023804}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:00:57,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6caf643fb8e657911b093994ed979ca0: 2023-09-13 21:00:57,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f51221dc784c47259d0317027b3c947b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61164393, jitterRate=-0.08857952058315277}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:00:57,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f51221dc784c47259d0317027b3c947b: 2023-09-13 21:00:57,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0., pid=46, masterSystemTime=1694638857513 2023-09-13 21:00:57,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b., pid=45, masterSystemTime=1694638857512 2023-09-13 21:00:57,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:00:57,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:00:57,531 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6caf643fb8e657911b093994ed979ca0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:00:57,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:00:57,531 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694638857531"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638857531"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638857531"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638857531"}]},"ts":"1694638857531"} 2023-09-13 21:00:57,532 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f51221dc784c47259d0317027b3c947b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,532 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694638857531"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638857531"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638857531"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638857531"}]},"ts":"1694638857531"} 2023-09-13 21:00:57,535 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-13 21:00:57,535 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 6caf643fb8e657911b093994ed979ca0, server=jenkins-hbase4.apache.org,42107,1694638816311 in 172 msec 2023-09-13 21:00:57,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-13 21:00:57,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure f51221dc784c47259d0317027b3c947b, server=jenkins-hbase4.apache.org,43255,1694638816358 in 173 msec 2023-09-13 21:00:57,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f51221dc784c47259d0317027b3c947b, ASSIGN in 336 msec 2023-09-13 21:00:57,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-13 21:00:57,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6caf643fb8e657911b093994ed979ca0, ASSIGN in 339 msec 2023-09-13 21:00:57,541 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 21:00:57,541 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638857541"}]},"ts":"1694638857541"} 2023-09-13 21:00:57,542 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-13 21:00:57,545 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 21:00:57,545 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-13 21:00:57,547 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-13 21:00:57,549 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:57,549 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:57,549 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:57,549 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:00:57,550 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-13 21:00:57,551 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-13 21:00:57,551 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-13 21:00:57,551 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-13 21:00:57,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 395 msec 2023-09-13 21:00:57,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-13 21:00:57,764 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-13 21:00:57,766 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-13 21:00:57,766 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:00:57,768 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 21:00:57,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 21:00:57,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694638857779 (current time:1694638857779). 2023-09-13 21:00:57,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 21:00:57,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x63ac15bf to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:57,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@412dc141, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:57,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:57,796 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:57,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63ac15bf to 127.0.0.1:61376 2023-09-13 21:00:57,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:00:57,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x41d4bbc7 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:57,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42d64faf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:57,805 DEBUG [hconnection-0x6ddeb97d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:57,807 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:57,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:57,814 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:57,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41d4bbc7 to 127.0.0.1:61376 2023-09-13 21:00:57,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:00:57,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-13 21:00:57,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 21:00:57,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 21:00:57,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 21:00:57,819 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 21:00:57,820 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694639457820 2023-09-13 21:00:57,820 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-13 21:00:57,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 21:00:57,821 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 21:00:57,822 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 21:00:57,823 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 21:00:57,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 21:00:57,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-13 21:00:57,825 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 21:00:57,825 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694639457825 2023-09-13 21:00:57,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,838 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-13 21:00:57,838 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:57,839 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-13 21:00:57,839 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-13 21:00:57,839 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,839 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,841 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,841 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:57,841 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:57,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:57,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:57,841 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:57,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:57,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:57,841 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:57,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:57,841 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,842 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,842 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 21:00:57,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-13 21:00:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-13 21:00:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-13 21:00:57,842 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 21:00:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,843 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 21:00:57,843 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 21:00:57,843 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:57,843 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 21:00:57,844 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,845 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 21:00:57,845 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 21:00:57,845 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-13 21:00:57,845 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-13 21:00:57,845 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,845 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:57,845 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 21:00:57,846 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 21:00:57,846 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-13 21:00:57,846 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-13 21:00:57,846 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:57,849 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 21:00:57,849 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-13 21:00:57,849 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-13 21:00:57,851 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,852 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,852 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:57,853 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,853 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:57,853 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:57,853 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,853 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:57,853 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:57,854 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,854 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:57,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-13 21:00:57,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64614af5[Count = 1] remaining members to acquire global barrier 2023-09-13 21:00:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:57,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-13 21:00:57,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64614af5[Count = 0] remaining members to acquire global barrier 2023-09-13 21:00:57,858 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-13 21:00:57,858 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,860 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,860 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,860 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,860 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 21:00:57,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,860 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-13 21:00:57,860 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,860 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44809,1694638816394' in zk 2023-09-13 21:00:57,860 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 21:00:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,860 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 21:00:57,860 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:00:57,861 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:00:57,861 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:00:57,861 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:00:57,861 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. started... 2023-09-13 21:00:57,861 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:00:57,861 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:00:57,861 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,861 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 21:00:57,861 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. started... 2023-09-13 21:00:57,862 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f51221dc784c47259d0317027b3c947b: 2023-09-13 21:00:57,862 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6caf643fb8e657911b093994ed979ca0: 2023-09-13 21:00:57,862 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,862 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:00:57,862 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 21:00:57,862 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,863 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:00:57,863 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 21:00:57,875 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. completed. 2023-09-13 21:00:57,875 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. completed. 2023-09-13 21:00:57,875 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:00:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 21:00:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:00:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:00:57,875 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:00:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:00:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:00:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-13 21:00:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-13 21:00:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43255,1694638816358' in zk 2023-09-13 21:00:57,875 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-13 21:00:57,877 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42107,1694638816311' in zk 2023-09-13 21:00:57,878 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,878 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 21:00:57,878 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,878 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:57,878 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 21:00:57,878 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-13 21:00:57,880 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:57,880 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-13 21:00:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43255,1694638816358': 2023-09-13 21:00:57,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-13 21:00:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:57,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42107,1694638816311': 2023-09-13 21:00:57,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-13 21:00:57,887 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-13 21:00:57,887 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 21:00:57,887 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 21:00:57,887 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,887 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 21:00:57,889 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,889 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:57,889 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:57,889 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,889 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,889 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:57,889 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:57,889 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,890 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:57,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:57,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:57,890 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:57,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,892 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:57,893 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:57,893 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:57,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:57,896 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:57,896 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,896 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,896 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:57,896 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:57,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:57,896 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:57,897 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:57,897 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:57,897 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:57,896 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:57,896 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:57,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:57,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:57,898 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:57,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:57,898 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-13 21:00:57,897 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:57,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,898 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:57,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 21:00:57,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:57,898 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:57,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:57,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:57,898 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:57,899 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:57,899 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:57,899 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 21:00:57,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,922 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:00:57,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-13 21:00:57,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-13 21:00:57,923 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 21:00:57,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,930 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-13 21:00:57,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,930 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-13 21:00:57,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694638857820Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694638857910 (+90 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1694638857910Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1694638857910Writing data manifest for emptySnaptb0-testConsecutiveExports at 1694638857914 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1694638857924 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694638857930 (+6 ms) 2023-09-13 21:00:57,933 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 21:00:57,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 112 msec 2023-09-13 21:00:58,123 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:00:58,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-13 21:00:58,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 21:00:58,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42107] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 21:00:58,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43255] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 21:00:58,132 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-13 21:00:58,132 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:00:58,132 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 21:00:58,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 21:00:58,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694638858142 (current time:1694638858142). 2023-09-13 21:00:58,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 21:00:58,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x1925db39 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:58,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6181503d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:58,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:58,157 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:58,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1925db39 to 127.0.0.1:61376 2023-09-13 21:00:58,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:00:58,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x0d68cd76 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:00:58,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a2333f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:00:58,171 DEBUG [hconnection-0x51c88c30-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:58,174 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:58,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:00:58,178 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:00:58,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d68cd76 to 127.0.0.1:61376 2023-09-13 21:00:58,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:00:58,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-13 21:00:58,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 21:00:58,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 21:00:58,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 21:00:58,184 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 21:00:58,184 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694639458184 2023-09-13 21:00:58,184 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-13 21:00:58,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 21:00:58,186 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 21:00:58,186 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 21:00:58,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 21:00:58,188 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 21:00:58,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-13 21:00:58,190 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 21:00:58,191 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694639458191 2023-09-13 21:00:58,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-13 21:00:58,200 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-13 21:00:58,200 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:58,201 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-13 21:00:58,201 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-13 21:00:58,202 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,202 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,204 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:58,204 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:58,204 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,204 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:58,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:58,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:58,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:58,204 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,204 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,205 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,205 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 21:00:58,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-13 21:00:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-13 21:00:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-13 21:00:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,205 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 21:00:58,205 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 21:00:58,205 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 21:00:58,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-13 21:00:58,206 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 21:00:58,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-13 21:00:58,206 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:58,206 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 21:00:58,206 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:58,208 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-13 21:00:58,209 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 21:00:58,209 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 21:00:58,209 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:00:58,209 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 21:00:58,209 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-13 21:00:58,209 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-13 21:00:58,210 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-13 21:00:58,210 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 21:00:58,210 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-13 21:00:58,210 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-13 21:00:58,210 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-13 21:00:58,212 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,212 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:58,213 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,213 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,213 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,213 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:58,213 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,213 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,213 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:58,214 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,214 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:00:58,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 21:00:58,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:58,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-13 21:00:58,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36d783de[Count = 1] remaining members to acquire global barrier 2023-09-13 21:00:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:58,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 21:00:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:58,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-13 21:00:58,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36d783de[Count = 0] remaining members to acquire global barrier 2023-09-13 21:00:58,217 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-13 21:00:58,217 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,219 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,219 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,219 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,219 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 21:00:58,219 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,219 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:00:58,219 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:00:58,219 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:00:58,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,219 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. started... 2023-09-13 21:00:58,220 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 21:00:58,219 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,220 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 21:00:58,219 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 21:00:58,220 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6caf643fb8e657911b093994ed979ca0 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-13 21:00:58,220 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-13 21:00:58,220 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44809,1694638816394' in zk 2023-09-13 21:00:58,220 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:00:58,220 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:00:58,220 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:00:58,220 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. started... 2023-09-13 21:00:58,220 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f51221dc784c47259d0317027b3c947b 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-13 21:00:58,222 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 21:00:58,222 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:58,222 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-13 21:00:58,246 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230913003433109a554ecf868bfaa4b799334a to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913003433109a554ecf868bfaa4b799334a 2023-09-13 21:00:58,248 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230913d29031656290416eadcd750de772f842 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230913d29031656290416eadcd750de772f842 2023-09-13 21:00:58,256 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/.tmp/cf/b5bdce69764348ccae0eaf8f5be15b7c 2023-09-13 21:00:58,257 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/.tmp/cf/41678f1e915b4abb9eee07420fc9a214 2023-09-13 21:00:58,266 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/.tmp/cf/b5bdce69764348ccae0eaf8f5be15b7c as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/cf/b5bdce69764348ccae0eaf8f5be15b7c 2023-09-13 21:00:58,267 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/.tmp/cf/41678f1e915b4abb9eee07420fc9a214 as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/cf/41678f1e915b4abb9eee07420fc9a214 2023-09-13 21:00:58,271 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/cf/b5bdce69764348ccae0eaf8f5be15b7c, entries=2, sequenceid=6, filesize=5.2 K 2023-09-13 21:00:58,272 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/cf/41678f1e915b4abb9eee07420fc9a214, entries=48, sequenceid=6, filesize=12.9 K 2023-09-13 21:00:58,272 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 6caf643fb8e657911b093994ed979ca0 in 52ms, sequenceid=6, compaction requested=false 2023-09-13 21:00:58,272 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-13 21:00:58,273 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6caf643fb8e657911b093994ed979ca0: 2023-09-13 21:00:58,273 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for f51221dc784c47259d0317027b3c947b in 53ms, sequenceid=6, compaction requested=false 2023-09-13 21:00:58,274 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f51221dc784c47259d0317027b3c947b: 2023-09-13 21:00:58,274 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-13 21:00:58,275 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:00:58,275 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-13 21:00:58,275 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/cf/b5bdce69764348ccae0eaf8f5be15b7c] hfiles 2023-09-13 21:00:58,275 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/cf/b5bdce69764348ccae0eaf8f5be15b7c for snapshot=snaptb0-testConsecutiveExports 2023-09-13 21:00:58,275 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:00:58,275 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/cf/41678f1e915b4abb9eee07420fc9a214] hfiles 2023-09-13 21:00:58,275 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/cf/41678f1e915b4abb9eee07420fc9a214 for snapshot=snaptb0-testConsecutiveExports 2023-09-13 21:00:58,285 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. completed. 2023-09-13 21:00:58,285 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:00:58,285 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:00:58,285 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:00:58,285 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,285 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-13 21:00:58,285 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43255,1694638816358' in zk 2023-09-13 21:00:58,285 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. completed. 2023-09-13 21:00:58,285 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:00:58,285 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:00:58,285 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:00:58,285 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,286 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-13 21:00:58,286 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42107,1694638816311' in zk 2023-09-13 21:00:58,286 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:00:58,287 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 21:00:58,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-13 21:00:58,287 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:58,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-13 21:00:58,287 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,287 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-13 21:00:58,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:58,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:58,289 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 21:00:58,289 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:58,290 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 21:00:58,290 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:58,290 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-13 21:00:58,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:58,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 21:00:58,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:58,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:58,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 21:00:58,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:58,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43255,1694638816358': 2023-09-13 21:00:58,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-13 21:00:58,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:58,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:58,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:58,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:58,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 21:00:58,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:58,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:58,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 21:00:58,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:58,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42107,1694638816311': 2023-09-13 21:00:58,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-13 21:00:58,297 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-13 21:00:58,297 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 21:00:58,297 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 21:00:58,297 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-13 21:00:58,297 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 21:00:58,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:58,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:00:58,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:00:58,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:58,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,299 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:58,299 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:00:58,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:58,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:58,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:58,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:58,300 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:58,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:58,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 21:00:58,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,300 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:58,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:00:58,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 21:00:58,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:58,302 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:00:58,302 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 21:00:58,302 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:58,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:58,308 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:58,308 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,308 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:58,308 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:58,308 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:00:58,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:58,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:58,308 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,309 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:00:58,309 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-13 21:00:58,309 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:58,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:58,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:58,308 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:58,308 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:00:58,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:00:58,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:58,310 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-13 21:00:58,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:58,309 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-13 21:00:58,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:00:58,311 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 21:00:58,311 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:00:58,311 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,311 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:00:58,311 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:00:58,312 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,312 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:00:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:00:58,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230913d29031656290416eadcd750de772f842, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913003433109a554ecf868bfaa4b799334a] mob files 2023-09-13 21:00:58,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230913d29031656290416eadcd750de772f842 2023-09-13 21:00:58,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913003433109a554ecf868bfaa4b799334a 2023-09-13 21:00:58,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-13 21:00:58,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-13 21:00:58,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,345 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694638858185Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694638858323 (+138 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1694638858323Loading Region manifests for snaptb0-testConsecutiveExports at 1694638858323Writing data manifest for snaptb0-testConsecutiveExports at 1694638858327 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1694638858338 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694638858345 (+7 ms) 2023-09-13 21:00:58,348 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 21:00:58,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 163 msec 2023-09-13 21:00:58,489 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:00:58,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-13 21:00:58,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 21:00:58,491 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491 2023-09-13 21:00:58,491 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491, srcFsUri=hdfs://localhost:45325, srcDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:00:58,512 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:00:58,512 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@59cd5b80, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,513 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19, snapshotDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-13 21:00:58,521 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 21:00:58,533 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:58,533 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:58,534 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:58,534 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:59,422 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-1072885492548922117.jar 2023-09-13 21:00:59,422 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:59,423 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:59,489 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-2057998974364165511.jar 2023-09-13 21:00:59,490 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:59,490 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:59,491 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:59,491 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:59,491 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:59,492 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 21:00:59,492 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 21:00:59,492 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 21:00:59,493 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 21:00:59,493 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 21:00:59,493 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 21:00:59,494 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 21:00:59,494 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 21:00:59,495 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 21:00:59,495 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 21:00:59,495 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 21:00:59,496 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:00:59,496 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:00:59,497 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:00:59,497 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:00:59,497 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:00:59,498 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:00:59,498 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:00:59,861 WARN [Listener at jenkins-hbase4.apache.org/36385] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 21:00:59,863 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-13 21:00:59,866 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-13 21:01:01,382 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:01:01,382 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:01:01,385 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0002_000001 (auth:SIMPLE) 2023-09-13 21:01:02,191 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0003_000001 (auth:SIMPLE) 2023-09-13 21:01:02,435 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 21:01:05,845 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0003_000001 (auth:SIMPLE) 2023-09-13 21:01:08,064 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0003_000001 (auth:SIMPLE) 2023-09-13 21:01:10,749 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0003_000001 (auth:SIMPLE) 2023-09-13 21:01:12,053 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 21:01:12,054 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 21:01:12,058 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-13 21:01:12,058 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 21:01:12,059 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 21:01:12,059 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1883159808_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 21:01:12,062 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-13 21:01:12,062 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-13 21:01:12,062 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@427f91af in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 21:01:12,062 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-13 21:01:12,062 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-13 21:01:12,063 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491, srcFsUri=hdfs://localhost:45325, srcDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:01:12,084 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:01:12,084 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@20157b8b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 21:01:12,084 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19, snapshotDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-13 21:01:12,095 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 21:01:12,106 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:12,107 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:12,107 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:12,108 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:12,994 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-8999896057109890789.jar 2023-09-13 21:01:12,995 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:12,995 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:13,062 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-308587884534727505.jar 2023-09-13 21:01:13,062 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:13,063 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:13,063 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:13,063 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:13,064 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:13,064 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:13,064 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 21:01:13,065 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 21:01:13,066 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 21:01:13,066 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 21:01:13,066 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 21:01:13,067 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 21:01:13,067 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 21:01:13,067 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 21:01:13,068 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 21:01:13,068 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 21:01:13,069 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:13,069 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:13,070 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:01:13,070 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:13,070 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:13,071 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:01:13,071 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:01:13,457 WARN [Listener at jenkins-hbase4.apache.org/36385] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 21:01:13,459 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-13 21:01:13,461 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-13 21:01:16,918 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:01:16,919 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:01:16,922 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0003_000001 (auth:SIMPLE) 2023-09-13 21:01:17,394 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0004_000001 (auth:SIMPLE) 2023-09-13 21:01:21,034 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0004_000001 (auth:SIMPLE) 2023-09-13 21:01:23,244 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0004_000001 (auth:SIMPLE) 2023-09-13 21:01:25,481 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0004_000001 (auth:SIMPLE) 2023-09-13 21:01:26,620 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 21:01:26,620 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 21:01:26,624 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-13 21:01:26,624 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 21:01:26,624 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 21:01:26,624 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1883159808_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 21:01:26,627 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-13 21:01:26,627 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-13 21:01:26,627 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@427f91af in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 21:01:26,627 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-13 21:01:26,627 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/local-export-1694638858491/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-13 21:01:26,639 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-13 21:01:26,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-13 21:01:26,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-13 21:01:26,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-13 21:01:26,644 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638886644"}]},"ts":"1694638886644"} 2023-09-13 21:01:26,645 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-13 21:01:26,647 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-13 21:01:26,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6caf643fb8e657911b093994ed979ca0, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f51221dc784c47259d0317027b3c947b, UNASSIGN}] 2023-09-13 21:01:26,649 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6caf643fb8e657911b093994ed979ca0, UNASSIGN 2023-09-13 21:01:26,650 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f51221dc784c47259d0317027b3c947b, UNASSIGN 2023-09-13 21:01:26,650 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6caf643fb8e657911b093994ed979ca0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:26,650 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f51221dc784c47259d0317027b3c947b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:26,650 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694638886650"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638886650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638886650"}]},"ts":"1694638886650"} 2023-09-13 21:01:26,650 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694638886650"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638886650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638886650"}]},"ts":"1694638886650"} 2023-09-13 21:01:26,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 6caf643fb8e657911b093994ed979ca0, server=jenkins-hbase4.apache.org,42107,1694638816311}] 2023-09-13 21:01:26,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure f51221dc784c47259d0317027b3c947b, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:01:26,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-13 21:01:26,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6caf643fb8e657911b093994ed979ca0 2023-09-13 21:01:26,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f51221dc784c47259d0317027b3c947b 2023-09-13 21:01:26,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6caf643fb8e657911b093994ed979ca0, disabling compactions & flushes 2023-09-13 21:01:26,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f51221dc784c47259d0317027b3c947b, disabling compactions & flushes 2023-09-13 21:01:26,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:01:26,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:01:26,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:01:26,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:01:26,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. after waiting 0 ms 2023-09-13 21:01:26,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:01:26,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. after waiting 0 ms 2023-09-13 21:01:26,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:01:26,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 21:01:26,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 21:01:26,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:01:26,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:01:26,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0. 2023-09-13 21:01:26,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b. 2023-09-13 21:01:26,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6caf643fb8e657911b093994ed979ca0: 2023-09-13 21:01:26,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f51221dc784c47259d0317027b3c947b: 2023-09-13 21:01:26,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6caf643fb8e657911b093994ed979ca0 2023-09-13 21:01:26,821 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6caf643fb8e657911b093994ed979ca0, regionState=CLOSED 2023-09-13 21:01:26,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f51221dc784c47259d0317027b3c947b 2023-09-13 21:01:26,822 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694638886821"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638886821"}]},"ts":"1694638886821"} 2023-09-13 21:01:26,822 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f51221dc784c47259d0317027b3c947b, regionState=CLOSED 2023-09-13 21:01:26,822 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694638886822"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638886822"}]},"ts":"1694638886822"} 2023-09-13 21:01:26,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-13 21:01:26,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 6caf643fb8e657911b093994ed979ca0, server=jenkins-hbase4.apache.org,42107,1694638816311 in 172 msec 2023-09-13 21:01:26,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-13 21:01:26,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure f51221dc784c47259d0317027b3c947b, server=jenkins-hbase4.apache.org,43255,1694638816358 in 172 msec 2023-09-13 21:01:26,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6caf643fb8e657911b093994ed979ca0, UNASSIGN in 177 msec 2023-09-13 21:01:26,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-13 21:01:26,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f51221dc784c47259d0317027b3c947b, UNASSIGN in 177 msec 2023-09-13 21:01:26,827 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638886827"}]},"ts":"1694638886827"} 2023-09-13 21:01:26,828 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-13 21:01:26,830 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-13 21:01:26,832 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 190 msec 2023-09-13 21:01:26,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-13 21:01:26,946 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-13 21:01:26,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-13 21:01:26,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 21:01:26,950 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 21:01:26,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-13 21:01:26,950 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 21:01:26,952 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-13 21:01:26,956 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0 2023-09-13 21:01:26,956 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b 2023-09-13 21:01:26,956 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 21:01:26,956 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 21:01:26,956 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 21:01:26,956 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 21:01:26,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-13 21:01:26,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-13 21:01:26,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-13 21:01:26,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-13 21:01:26,958 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 21:01:26,958 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 21:01:26,958 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 21:01:26,958 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:26,958 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:26,958 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:26,958 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 21:01:26,958 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:26,958 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/recovered.edits] 2023-09-13 21:01:26,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-13 21:01:26,959 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/recovered.edits] 2023-09-13 21:01:26,964 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/cf/b5bdce69764348ccae0eaf8f5be15b7c to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/cf/b5bdce69764348ccae0eaf8f5be15b7c 2023-09-13 21:01:26,964 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/cf/41678f1e915b4abb9eee07420fc9a214 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/cf/41678f1e915b4abb9eee07420fc9a214 2023-09-13 21:01:26,966 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/recovered.edits/9.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0/recovered.edits/9.seqid 2023-09-13 21:01:26,967 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/recovered.edits/9.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b/recovered.edits/9.seqid 2023-09-13 21:01:26,967 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/6caf643fb8e657911b093994ed979ca0 2023-09-13 21:01:26,967 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testConsecutiveExports/f51221dc784c47259d0317027b3c947b 2023-09-13 21:01:26,967 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-13 21:01:26,968 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-13 21:01:26,968 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-13 21:01:26,971 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230913d29031656290416eadcd750de772f842 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230913d29031656290416eadcd750de772f842 2023-09-13 21:01:26,973 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913003433109a554ecf868bfaa4b799334a to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913003433109a554ecf868bfaa4b799334a 2023-09-13 21:01:26,973 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-13 21:01:26,975 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 21:01:26,977 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-13 21:01:26,979 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-13 21:01:26,980 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 21:01:26,980 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-13 21:01:26,980 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694638886980"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:26,980 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694638886980"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:26,982 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 21:01:26,982 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6caf643fb8e657911b093994ed979ca0, NAME => 'testtb-testConsecutiveExports,,1694638857155.6caf643fb8e657911b093994ed979ca0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f51221dc784c47259d0317027b3c947b, NAME => 'testtb-testConsecutiveExports,1,1694638857155.f51221dc784c47259d0317027b3c947b.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 21:01:26,982 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-13 21:01:26,982 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694638886982"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:26,984 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-13 21:01:26,986 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 21:01:26,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 39 msec 2023-09-13 21:01:27,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-13 21:01:27,060 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-13 21:01:27,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-13 21:01:27,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-13 21:01:27,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-13 21:01:27,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-13 21:01:27,095 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=752 (was 767), OpenFileDescriptor=907 (was 938), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 200) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8587 (was 8704) 2023-09-13 21:01:27,095 WARN [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-13 21:01:27,113 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=752, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=170, AvailableMemoryMB=8586 2023-09-13 21:01:27,113 WARN [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-09-13 21:01:27,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 21:01:27,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,118 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 21:01:27,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-13 21:01:27,118 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 21:01:27,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-13 21:01:27,121 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3 2023-09-13 21:01:27,121 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250 2023-09-13 21:01:27,122 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3 empty. 2023-09-13 21:01:27,122 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250 empty. 2023-09-13 21:01:27,122 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3 2023-09-13 21:01:27,122 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250 2023-09-13 21:01:27,122 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-13 21:01:27,132 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-13 21:01:27,133 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => ece8640e5a4229c921bb2880d8a181d3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:01:27,133 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 20907fba32e76b38444845150e8c1250, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:01:27,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:27,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing ece8640e5a4229c921bb2880d8a181d3, disabling compactions & flushes 2023-09-13 21:01:27,141 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:27,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:27,141 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. after waiting 0 ms 2023-09-13 21:01:27,142 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:27,142 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:27,142 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for ece8640e5a4229c921bb2880d8a181d3: 2023-09-13 21:01:27,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:27,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 20907fba32e76b38444845150e8c1250, disabling compactions & flushes 2023-09-13 21:01:27,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:27,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:27,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. after waiting 0 ms 2023-09-13 21:01:27,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:27,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:27,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 20907fba32e76b38444845150e8c1250: 2023-09-13 21:01:27,148 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 21:01:27,149 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694638887149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638887149"}]},"ts":"1694638887149"} 2023-09-13 21:01:27,149 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694638887149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638887149"}]},"ts":"1694638887149"} 2023-09-13 21:01:27,155 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 21:01:27,156 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 21:01:27,156 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638887156"}]},"ts":"1694638887156"} 2023-09-13 21:01:27,157 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-13 21:01:27,160 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 21:01:27,161 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 21:01:27,161 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 21:01:27,161 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 21:01:27,161 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 21:01:27,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ece8640e5a4229c921bb2880d8a181d3, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20907fba32e76b38444845150e8c1250, ASSIGN}] 2023-09-13 21:01:27,164 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ece8640e5a4229c921bb2880d8a181d3, ASSIGN 2023-09-13 21:01:27,164 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20907fba32e76b38444845150e8c1250, ASSIGN 2023-09-13 21:01:27,165 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20907fba32e76b38444845150e8c1250, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44809,1694638816394; forceNewPlan=false, retain=false 2023-09-13 21:01:27,165 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ece8640e5a4229c921bb2880d8a181d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43255,1694638816358; forceNewPlan=false, retain=false 2023-09-13 21:01:27,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-13 21:01:27,315 INFO [jenkins-hbase4:33631] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 21:01:27,317 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=20907fba32e76b38444845150e8c1250, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:27,317 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ece8640e5a4229c921bb2880d8a181d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,317 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694638887317"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638887317"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638887317"}]},"ts":"1694638887317"} 2023-09-13 21:01:27,317 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694638887317"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638887317"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638887317"}]},"ts":"1694638887317"} 2023-09-13 21:01:27,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 20907fba32e76b38444845150e8c1250, server=jenkins-hbase4.apache.org,44809,1694638816394}] 2023-09-13 21:01:27,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure ece8640e5a4229c921bb2880d8a181d3, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:01:27,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-13 21:01:27,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:27,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:27,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 20907fba32e76b38444845150e8c1250, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 21:01:27,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ece8640e5a4229c921bb2880d8a181d3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 21:01:27,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. service=AccessControlService 2023-09-13 21:01:27,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. service=AccessControlService 2023-09-13 21:01:27,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:01:27,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:01:27,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ece8640e5a4229c921bb2880d8a181d3 2023-09-13 21:01:27,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 20907fba32e76b38444845150e8c1250 2023-09-13 21:01:27,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:27,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:27,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ece8640e5a4229c921bb2880d8a181d3 2023-09-13 21:01:27,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 20907fba32e76b38444845150e8c1250 2023-09-13 21:01:27,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ece8640e5a4229c921bb2880d8a181d3 2023-09-13 21:01:27,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 20907fba32e76b38444845150e8c1250 2023-09-13 21:01:27,480 INFO [StoreOpener-20907fba32e76b38444845150e8c1250-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 20907fba32e76b38444845150e8c1250 2023-09-13 21:01:27,480 INFO [StoreOpener-ece8640e5a4229c921bb2880d8a181d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ece8640e5a4229c921bb2880d8a181d3 2023-09-13 21:01:27,482 DEBUG [StoreOpener-ece8640e5a4229c921bb2880d8a181d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/cf 2023-09-13 21:01:27,482 DEBUG [StoreOpener-ece8640e5a4229c921bb2880d8a181d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/cf 2023-09-13 21:01:27,482 DEBUG [StoreOpener-20907fba32e76b38444845150e8c1250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/cf 2023-09-13 21:01:27,482 DEBUG [StoreOpener-20907fba32e76b38444845150e8c1250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/cf 2023-09-13 21:01:27,483 INFO [StoreOpener-ece8640e5a4229c921bb2880d8a181d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ece8640e5a4229c921bb2880d8a181d3 columnFamilyName cf 2023-09-13 21:01:27,483 INFO [StoreOpener-20907fba32e76b38444845150e8c1250-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20907fba32e76b38444845150e8c1250 columnFamilyName cf 2023-09-13 21:01:27,484 INFO [StoreOpener-ece8640e5a4229c921bb2880d8a181d3-1] regionserver.HStore(310): Store=ece8640e5a4229c921bb2880d8a181d3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:01:27,484 INFO [StoreOpener-20907fba32e76b38444845150e8c1250-1] regionserver.HStore(310): Store=20907fba32e76b38444845150e8c1250/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:01:27,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250 2023-09-13 21:01:27,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250 2023-09-13 21:01:27,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3 2023-09-13 21:01:27,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3 2023-09-13 21:01:27,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 20907fba32e76b38444845150e8c1250 2023-09-13 21:01:27,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ece8640e5a4229c921bb2880d8a181d3 2023-09-13 21:01:27,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:01:27,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:01:27,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 20907fba32e76b38444845150e8c1250; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63161669, jitterRate=-0.0588177889585495}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:01:27,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ece8640e5a4229c921bb2880d8a181d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72638095, jitterRate=0.08239196240901947}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:01:27,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 20907fba32e76b38444845150e8c1250: 2023-09-13 21:01:27,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ece8640e5a4229c921bb2880d8a181d3: 2023-09-13 21:01:27,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250., pid=60, masterSystemTime=1694638887471 2023-09-13 21:01:27,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3., pid=61, masterSystemTime=1694638887471 2023-09-13 21:01:27,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:27,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:27,496 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=20907fba32e76b38444845150e8c1250, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:27,496 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694638887496"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638887496"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638887496"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638887496"}]},"ts":"1694638887496"} 2023-09-13 21:01:27,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:27,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:27,496 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ece8640e5a4229c921bb2880d8a181d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,497 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694638887496"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638887496"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638887496"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638887496"}]},"ts":"1694638887496"} 2023-09-13 21:01:27,500 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-13 21:01:27,500 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 20907fba32e76b38444845150e8c1250, server=jenkins-hbase4.apache.org,44809,1694638816394 in 179 msec 2023-09-13 21:01:27,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-13 21:01:27,502 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure ece8640e5a4229c921bb2880d8a181d3, server=jenkins-hbase4.apache.org,43255,1694638816358 in 179 msec 2023-09-13 21:01:27,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20907fba32e76b38444845150e8c1250, ASSIGN in 338 msec 2023-09-13 21:01:27,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-13 21:01:27,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ece8640e5a4229c921bb2880d8a181d3, ASSIGN in 340 msec 2023-09-13 21:01:27,505 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 21:01:27,505 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638887505"}]},"ts":"1694638887505"} 2023-09-13 21:01:27,506 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-13 21:01:27,508 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 21:01:27,509 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-13 21:01:27,511 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-13 21:01:27,512 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:27,512 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:27,512 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:27,512 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:27,515 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:27,515 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:27,515 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:27,515 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:27,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 399 msec 2023-09-13 21:01:27,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-13 21:01:27,722 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-13 21:01:27,724 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,725 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:27,726 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 21:01:27,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 21:01:27,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694638887740 (current time:1694638887740). 2023-09-13 21:01:27,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 21:01:27,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x4de49e4b to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:27,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70f8487c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:27,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:27,754 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:27,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4de49e4b to 127.0.0.1:61376 2023-09-13 21:01:27,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:27,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x4d1ecc04 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:27,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24e1152a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:27,762 DEBUG [hconnection-0x16e81262-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:27,763 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:27,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:27,769 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:27,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d1ecc04 to 127.0.0.1:61376 2023-09-13 21:01:27,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:27,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-13 21:01:27,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 21:01:27,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 21:01:27,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 21:01:27,774 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 21:01:27,775 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694639487775 2023-09-13 21:01:27,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 21:01:27,775 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,776 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 21:01:27,776 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 21:01:27,777 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 21:01:27,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 21:01:27,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-13 21:01:27,779 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 21:01:27,779 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694639487779 2023-09-13 21:01:27,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,789 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-13 21:01:27,789 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:27,790 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-13 21:01:27,790 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-13 21:01:27,790 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,790 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,792 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:27,792 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:27,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:27,792 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,792 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:27,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:27,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:27,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:27,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:27,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:27,793 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,793 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:27,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,793 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:27,793 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 21:01:27,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-13 21:01:27,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-13 21:01:27,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-13 21:01:27,794 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 21:01:27,794 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 21:01:27,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,794 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 21:01:27,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,794 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 21:01:27,794 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 21:01:27,794 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:27,794 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:27,795 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 21:01:27,796 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 21:01:27,796 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 21:01:27,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,796 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 21:01:27,796 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 21:01:27,796 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:27,796 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 21:01:27,797 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 21:01:27,797 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 21:01:27,797 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 21:01:27,797 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 21:01:27,798 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,798 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:27,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:27,799 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:27,799 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,799 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:27,799 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,799 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:27,800 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,800 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:27,800 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,800 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:27,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:27,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:27,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:27,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:27,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-13 21:01:27,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67755880[Count = 1] remaining members to acquire global barrier 2023-09-13 21:01:27,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:27,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:27,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:27,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:27,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:27,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:27,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:27,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-13 21:01:27,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67755880[Count = 0] remaining members to acquire global barrier 2023-09-13 21:01:27,803 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-13 21:01:27,803 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,804 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,804 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,805 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 21:01:27,804 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:01:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 21:01:27,805 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:27,805 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:01:27,805 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 21:01:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:01:27,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,805 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:01:27,805 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. started... 2023-09-13 21:01:27,805 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. started... 2023-09-13 21:01:27,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 21:01:27,805 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 21:01:27,806 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ece8640e5a4229c921bb2880d8a181d3: 2023-09-13 21:01:27,806 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20907fba32e76b38444845150e8c1250: 2023-09-13 21:01:27,806 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42107,1694638816311' in zk 2023-09-13 21:01:27,806 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,806 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,806 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:01:27,807 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:01:27,807 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 21:01:27,807 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 21:01:27,815 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 21:01:27,815 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:27,815 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 21:01:27,817 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. completed. 2023-09-13 21:01:27,817 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:27,817 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:01:27,817 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:01:27,817 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,817 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 21:01:27,817 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43255,1694638816358' in zk 2023-09-13 21:01:27,819 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 21:01:27,819 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,819 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:27,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:27,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:27,819 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 21:01:27,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:27,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:27,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:27,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:27,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:27,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:27,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:27,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:27,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43255,1694638816358': 2023-09-13 21:01:27,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-13 21:01:27,876 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:01:27,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-13 21:01:27,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-13 21:01:27,877 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 21:01:28,077 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:01:28,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-13 21:01:28,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-13 21:01:28,079 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-13 21:01:28,219 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. completed. 2023-09-13 21:01:28,219 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:28,219 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:01:28,219 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:01:28,219 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,220 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 21:01:28,220 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44809,1694638816394' in zk 2023-09-13 21:01:28,221 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 21:01:28,221 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,221 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:28,221 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 21:01:28,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:28,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44809,1694638816394': 2023-09-13 21:01:28,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-13 21:01:28,227 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-13 21:01:28,227 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 21:01:28,227 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 21:01:28,227 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,227 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 21:01:28,229 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,229 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,229 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:28,229 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,229 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,229 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:28,230 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:28,229 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,230 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:28,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:28,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:28,230 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:28,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:28,232 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,233 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,233 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,236 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,236 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,236 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:28,236 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:28,236 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:28,236 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:28,236 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,236 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:28,238 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,238 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:28,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:28,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:28,236 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,236 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:28,238 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:28,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:28,236 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:28,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:28,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:28,238 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:28,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:28,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:28,238 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 21:01:28,239 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:28,239 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,239 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,239 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 21:01:28,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,271 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-13 21:01:28,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,272 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694638887775Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694638888250 (+475 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694638888250Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694638888250Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694638888258 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694638888265 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694638888271 (+6 ms) 2023-09-13 21:01:28,275 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 21:01:28,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 499 msec 2023-09-13 21:01:28,379 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:01:28,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-13 21:01:28,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 21:01:28,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43255] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 21:01:28,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44809] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 21:01:28,386 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,386 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:28,386 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 21:01:28,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 21:01:28,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694638888396 (current time:1694638888396). 2023-09-13 21:01:28,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 21:01:28,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x2ecc6948 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:28,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45d95d85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:28,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:28,407 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:28,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ecc6948 to 127.0.0.1:61376 2023-09-13 21:01:28,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:28,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x498ef692 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:28,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c540c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:28,418 DEBUG [hconnection-0xb7f00aa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:28,421 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:28,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:28,426 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:28,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x498ef692 to 127.0.0.1:61376 2023-09-13 21:01:28,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:28,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-13 21:01:28,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 21:01:28,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 21:01:28,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 21:01:28,436 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 21:01:28,437 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694639488436 2023-09-13 21:01:28,437 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 21:01:28,438 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 21:01:28,438 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 21:01:28,439 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 21:01:28,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 21:01:28,440 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-09-13 21:01:28,441 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 21:01:28,442 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694639488442 2023-09-13 21:01:28,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,453 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-13 21:01:28,453 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:28,455 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-13 21:01:28,455 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-13 21:01:28,455 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,455 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,457 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,457 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:28,457 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:28,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:28,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:28,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:28,457 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:28,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:28,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:28,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:28,457 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,457 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,458 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,458 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 21:01:28,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-13 21:01:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-13 21:01:28,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-13 21:01:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 21:01:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 21:01:28,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 21:01:28,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,459 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 21:01:28,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,459 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:28,459 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 21:01:28,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 21:01:28,461 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 21:01:28,461 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:28,461 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 21:01:28,462 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 21:01:28,462 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 21:01:28,462 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 21:01:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:28,462 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 21:01:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 21:01:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 21:01:28,463 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 21:01:28,464 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,464 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,464 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:28,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:28,468 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,468 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,468 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:28,468 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,468 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:28,468 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:28,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:28,469 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,469 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:28,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:28,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-13 21:01:28,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bb06d47[Count = 1] remaining members to acquire global barrier 2023-09-13 21:01:28,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:28,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:28,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:28,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:28,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:28,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-13 21:01:28,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bb06d47[Count = 0] remaining members to acquire global barrier 2023-09-13 21:01:28,472 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-13 21:01:28,472 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,474 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,474 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,474 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,474 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 21:01:28,474 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,475 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 21:01:28,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,475 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 21:01:28,475 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,475 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 21:01:28,475 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 21:01:28,475 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42107,1694638816311' in zk 2023-09-13 21:01:28,475 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:01:28,475 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:28,475 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:01:28,475 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:01:28,475 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:01:28,475 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. started... 2023-09-13 21:01:28,475 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:28,475 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. started... 2023-09-13 21:01:28,475 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ece8640e5a4229c921bb2880d8a181d3 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-09-13 21:01:28,476 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 20907fba32e76b38444845150e8c1250 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-09-13 21:01:28,477 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 21:01:28,477 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:28,477 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 21:01:28,497 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091380fb7fed9f29413ab23729170263c480 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091380fb7fed9f29413ab23729170263c480 2023-09-13 21:01:28,500 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230913edd4d21abfde4269baabb7618996411e to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230913edd4d21abfde4269baabb7618996411e 2023-09-13 21:01:28,504 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/.tmp/cf/12d19bc8c97f43a3a8bad79b87b94030 2023-09-13 21:01:28,507 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/.tmp/cf/682277869e8c4e27b62bc6204bd5e511 2023-09-13 21:01:28,510 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/.tmp/cf/12d19bc8c97f43a3a8bad79b87b94030 as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/cf/12d19bc8c97f43a3a8bad79b87b94030 2023-09-13 21:01:28,513 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/.tmp/cf/682277869e8c4e27b62bc6204bd5e511 as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/cf/682277869e8c4e27b62bc6204bd5e511 2023-09-13 21:01:28,517 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/cf/12d19bc8c97f43a3a8bad79b87b94030, entries=43, sequenceid=6, filesize=12.8 K 2023-09-13 21:01:28,518 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 20907fba32e76b38444845150e8c1250 in 43ms, sequenceid=6, compaction requested=false 2023-09-13 21:01:28,518 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-13 21:01:28,519 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20907fba32e76b38444845150e8c1250: 2023-09-13 21:01:28,519 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,519 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/cf/682277869e8c4e27b62bc6204bd5e511, entries=7, sequenceid=6, filesize=6.2 K 2023-09-13 21:01:28,519 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:01:28,519 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/cf/12d19bc8c97f43a3a8bad79b87b94030] hfiles 2023-09-13 21:01:28,519 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/cf/12d19bc8c97f43a3a8bad79b87b94030 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,520 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for ece8640e5a4229c921bb2880d8a181d3 in 45ms, sequenceid=6, compaction requested=false 2023-09-13 21:01:28,522 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ece8640e5a4229c921bb2880d8a181d3: 2023-09-13 21:01:28,522 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,522 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:01:28,522 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/cf/682277869e8c4e27b62bc6204bd5e511] hfiles 2023-09-13 21:01:28,522 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/cf/682277869e8c4e27b62bc6204bd5e511 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,531 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. completed. 2023-09-13 21:01:28,531 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:28,531 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:01:28,531 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:01:28,531 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,532 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 21:01:28,532 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43255,1694638816358' in zk 2023-09-13 21:01:28,532 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. completed. 2023-09-13 21:01:28,532 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:28,532 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:01:28,532 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:01:28,532 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,532 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 21:01:28,532 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44809,1694638816394' in zk 2023-09-13 21:01:28,533 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 21:01:28,533 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,533 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:28,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,534 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 21:01:28,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:28,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:28,537 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:28,537 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 21:01:28,537 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:28,538 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 21:01:28,539 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:01:28,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:28,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-13 21:01:28,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-13 21:01:28,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,541 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 21:01:28,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:28,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43255,1694638816358': 2023-09-13 21:01:28,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-13 21:01:28,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:28,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:28,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:28,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:28,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:28,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44809,1694638816394': 2023-09-13 21:01:28,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-13 21:01:28,546 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-13 21:01:28,546 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 21:01:28,546 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 21:01:28,546 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,546 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 21:01:28,551 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,551 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:28,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:28,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,551 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:28,551 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,551 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,552 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:28,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,552 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:28,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:28,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,552 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:28,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:28,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:28,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:28,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:28,552 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:28,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:28,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,553 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:28,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,558 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,558 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,559 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,562 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,562 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:28,562 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:28,562 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:28,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:28,562 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:28,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:28,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:28,563 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,563 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:28,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:28,562 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:28,562 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:28,563 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,563 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:28,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:28,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 21:01:28,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:28,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:28,563 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:28,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:28,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:28,565 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:28,566 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,566 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:28,566 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,566 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,566 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,566 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,566 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091380fb7fed9f29413ab23729170263c480, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230913edd4d21abfde4269baabb7618996411e] mob files 2023-09-13 21:01:28,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091380fb7fed9f29413ab23729170263c480 2023-09-13 21:01:28,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230913edd4d21abfde4269baabb7618996411e 2023-09-13 21:01:28,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,605 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-13 21:01:28,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,605 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:28,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694638888437Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694638888580 (+143 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694638888580Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1694638888580Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1694638888585 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694638888597 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694638888605 (+8 ms) 2023-09-13 21:01:28,608 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 21:01:28,609 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 170 msec 2023-09-13 21:01:28,741 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:01:28,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-13 21:01:28,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 21:01:28,770 DEBUG [Listener at jenkins-hbase4.apache.org/36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 21:01:28,776 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 21:01:28,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42107] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-13 21:01:28,778 DEBUG [Listener at jenkins-hbase4.apache.org/36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 21:01:28,779 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 21:01:28,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43255] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-13 21:01:28,780 DEBUG [Listener at jenkins-hbase4.apache.org/36385] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 21:01:28,784 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 21:01:28,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44809] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-13 21:01:28,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-13 21:01:28,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:28,789 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 21:01:28,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-13 21:01:28,789 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 21:01:28,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-13 21:01:28,792 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:28,792 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:28,792 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c empty. 2023-09-13 21:01:28,792 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d empty. 2023-09-13 21:01:28,793 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:28,793 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:28,793 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-13 21:01:28,803 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-13 21:01:28,805 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => d1cf6d1a2eeee42e1a22036474eab35d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:01:28,805 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 396cdce634c496b7f689070f27bf9d0c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:01:28,817 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:28,817 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing d1cf6d1a2eeee42e1a22036474eab35d, disabling compactions & flushes 2023-09-13 21:01:28,817 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. 2023-09-13 21:01:28,817 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. 2023-09-13 21:01:28,817 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. after waiting 0 ms 2023-09-13 21:01:28,817 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. 2023-09-13 21:01:28,817 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. 2023-09-13 21:01:28,817 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for d1cf6d1a2eeee42e1a22036474eab35d: 2023-09-13 21:01:28,817 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:28,818 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 396cdce634c496b7f689070f27bf9d0c, disabling compactions & flushes 2023-09-13 21:01:28,818 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. 2023-09-13 21:01:28,818 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. 2023-09-13 21:01:28,818 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. after waiting 0 ms 2023-09-13 21:01:28,818 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. 2023-09-13 21:01:28,818 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. 2023-09-13 21:01:28,818 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 396cdce634c496b7f689070f27bf9d0c: 2023-09-13 21:01:28,820 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 21:01:28,822 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694638888821"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638888821"}]},"ts":"1694638888821"} 2023-09-13 21:01:28,822 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694638888821"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638888821"}]},"ts":"1694638888821"} 2023-09-13 21:01:28,824 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 21:01:28,825 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 21:01:28,825 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638888825"}]},"ts":"1694638888825"} 2023-09-13 21:01:28,826 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-13 21:01:28,830 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 21:01:28,831 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 21:01:28,831 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 21:01:28,831 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 21:01:28,832 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 21:01:28,832 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=396cdce634c496b7f689070f27bf9d0c, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1cf6d1a2eeee42e1a22036474eab35d, ASSIGN}] 2023-09-13 21:01:28,835 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1cf6d1a2eeee42e1a22036474eab35d, ASSIGN 2023-09-13 21:01:28,835 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=396cdce634c496b7f689070f27bf9d0c, ASSIGN 2023-09-13 21:01:28,836 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1cf6d1a2eeee42e1a22036474eab35d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42107,1694638816311; forceNewPlan=false, retain=false 2023-09-13 21:01:28,836 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=396cdce634c496b7f689070f27bf9d0c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43255,1694638816358; forceNewPlan=false, retain=false 2023-09-13 21:01:28,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-13 21:01:28,986 INFO [jenkins-hbase4:33631] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 21:01:28,989 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=d1cf6d1a2eeee42e1a22036474eab35d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:28,989 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=396cdce634c496b7f689070f27bf9d0c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:28,989 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694638888988"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638888988"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638888988"}]},"ts":"1694638888988"} 2023-09-13 21:01:28,989 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694638888988"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638888988"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638888988"}]},"ts":"1694638888988"} 2023-09-13 21:01:28,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 396cdce634c496b7f689070f27bf9d0c, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:01:28,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure d1cf6d1a2eeee42e1a22036474eab35d, server=jenkins-hbase4.apache.org,42107,1694638816311}] 2023-09-13 21:01:29,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-13 21:01:29,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. 2023-09-13 21:01:29,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 396cdce634c496b7f689070f27bf9d0c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c.', STARTKEY => '', ENDKEY => '2'} 2023-09-13 21:01:29,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. 2023-09-13 21:01:29,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d1cf6d1a2eeee42e1a22036474eab35d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d.', STARTKEY => '2', ENDKEY => ''} 2023-09-13 21:01:29,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. service=AccessControlService 2023-09-13 21:01:29,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. service=AccessControlService 2023-09-13 21:01:29,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:01:29,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:01:29,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:29,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:29,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:29,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:29,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:29,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:29,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:29,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:29,149 INFO [StoreOpener-d1cf6d1a2eeee42e1a22036474eab35d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:29,149 INFO [StoreOpener-396cdce634c496b7f689070f27bf9d0c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:29,150 DEBUG [StoreOpener-d1cf6d1a2eeee42e1a22036474eab35d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/cf 2023-09-13 21:01:29,150 DEBUG [StoreOpener-d1cf6d1a2eeee42e1a22036474eab35d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/cf 2023-09-13 21:01:29,150 DEBUG [StoreOpener-396cdce634c496b7f689070f27bf9d0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/cf 2023-09-13 21:01:29,150 DEBUG [StoreOpener-396cdce634c496b7f689070f27bf9d0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/cf 2023-09-13 21:01:29,151 INFO [StoreOpener-396cdce634c496b7f689070f27bf9d0c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 396cdce634c496b7f689070f27bf9d0c columnFamilyName cf 2023-09-13 21:01:29,151 INFO [StoreOpener-d1cf6d1a2eeee42e1a22036474eab35d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1cf6d1a2eeee42e1a22036474eab35d columnFamilyName cf 2023-09-13 21:01:29,151 INFO [StoreOpener-396cdce634c496b7f689070f27bf9d0c-1] regionserver.HStore(310): Store=396cdce634c496b7f689070f27bf9d0c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:01:29,151 INFO [StoreOpener-d1cf6d1a2eeee42e1a22036474eab35d-1] regionserver.HStore(310): Store=d1cf6d1a2eeee42e1a22036474eab35d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:01:29,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:29,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:29,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:29,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:29,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:29,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:29,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:01:29,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:01:29,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 396cdce634c496b7f689070f27bf9d0c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62281943, jitterRate=-0.07192672789096832}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:01:29,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 396cdce634c496b7f689070f27bf9d0c: 2023-09-13 21:01:29,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d1cf6d1a2eeee42e1a22036474eab35d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67157623, jitterRate=7.265657186508179E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:01:29,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d1cf6d1a2eeee42e1a22036474eab35d: 2023-09-13 21:01:29,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c., pid=69, masterSystemTime=1694638889142 2023-09-13 21:01:29,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d., pid=70, masterSystemTime=1694638889143 2023-09-13 21:01:29,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. 2023-09-13 21:01:29,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. 2023-09-13 21:01:29,160 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=396cdce634c496b7f689070f27bf9d0c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:29,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. 2023-09-13 21:01:29,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. 2023-09-13 21:01:29,160 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694638889160"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638889160"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638889160"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638889160"}]},"ts":"1694638889160"} 2023-09-13 21:01:29,161 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=d1cf6d1a2eeee42e1a22036474eab35d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:29,161 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694638889161"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638889161"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638889161"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638889161"}]},"ts":"1694638889161"} 2023-09-13 21:01:29,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-13 21:01:29,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 396cdce634c496b7f689070f27bf9d0c, server=jenkins-hbase4.apache.org,43255,1694638816358 in 171 msec 2023-09-13 21:01:29,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-13 21:01:29,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure d1cf6d1a2eeee42e1a22036474eab35d, server=jenkins-hbase4.apache.org,42107,1694638816311 in 171 msec 2023-09-13 21:01:29,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=396cdce634c496b7f689070f27bf9d0c, ASSIGN in 332 msec 2023-09-13 21:01:29,166 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-13 21:01:29,166 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1cf6d1a2eeee42e1a22036474eab35d, ASSIGN in 332 msec 2023-09-13 21:01:29,166 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 21:01:29,167 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638889166"}]},"ts":"1694638889166"} 2023-09-13 21:01:29,167 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-13 21:01:29,169 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 21:01:29,170 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-13 21:01:29,171 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-13 21:01:29,173 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:29,173 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:29,173 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:29,173 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:29,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:29,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:29,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:29,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:29,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:29,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:29,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:29,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:29,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 388 msec 2023-09-13 21:01:29,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-13 21:01:29,394 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-13 21:01:29,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 396cdce634c496b7f689070f27bf9d0c, d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:29,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[396cdce634c496b7f689070f27bf9d0c, d1cf6d1a2eeee42e1a22036474eab35d], force=true 2023-09-13 21:01:29,429 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[396cdce634c496b7f689070f27bf9d0c, d1cf6d1a2eeee42e1a22036474eab35d], force=true 2023-09-13 21:01:29,429 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[396cdce634c496b7f689070f27bf9d0c, d1cf6d1a2eeee42e1a22036474eab35d], force=true 2023-09-13 21:01:29,429 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[396cdce634c496b7f689070f27bf9d0c, d1cf6d1a2eeee42e1a22036474eab35d], force=true 2023-09-13 21:01:29,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 21:01:29,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=396cdce634c496b7f689070f27bf9d0c, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1cf6d1a2eeee42e1a22036474eab35d, UNASSIGN}] 2023-09-13 21:01:29,455 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=396cdce634c496b7f689070f27bf9d0c, UNASSIGN 2023-09-13 21:01:29,455 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1cf6d1a2eeee42e1a22036474eab35d, UNASSIGN 2023-09-13 21:01:29,456 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=396cdce634c496b7f689070f27bf9d0c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:29,456 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=d1cf6d1a2eeee42e1a22036474eab35d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:29,456 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694638889456"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638889456"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638889456"}]},"ts":"1694638889456"} 2023-09-13 21:01:29,456 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694638889456"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638889456"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638889456"}]},"ts":"1694638889456"} 2023-09-13 21:01:29,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 396cdce634c496b7f689070f27bf9d0c, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:01:29,458 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure d1cf6d1a2eeee42e1a22036474eab35d, server=jenkins-hbase4.apache.org,42107,1694638816311}] 2023-09-13 21:01:29,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 21:01:29,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:29,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 396cdce634c496b7f689070f27bf9d0c, disabling compactions & flushes 2023-09-13 21:01:29,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. 2023-09-13 21:01:29,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. 2023-09-13 21:01:29,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. after waiting 0 ms 2023-09-13 21:01:29,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. 2023-09-13 21:01:29,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 396cdce634c496b7f689070f27bf9d0c 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-13 21:01:29,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:29,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d1cf6d1a2eeee42e1a22036474eab35d, disabling compactions & flushes 2023-09-13 21:01:29,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. 2023-09-13 21:01:29,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. 2023-09-13 21:01:29,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. after waiting 0 ms 2023-09-13 21:01:29,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. 2023-09-13 21:01:29,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d1cf6d1a2eeee42e1a22036474eab35d 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-13 21:01:29,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/.tmp/cf/63a8fd14c9034f4491bcfee5c0ded72b 2023-09-13 21:01:29,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/.tmp/cf/0eb670b1ff8446989a8d8d9a09517b47 2023-09-13 21:01:29,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/.tmp/cf/63a8fd14c9034f4491bcfee5c0ded72b as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/cf/63a8fd14c9034f4491bcfee5c0ded72b 2023-09-13 21:01:29,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/.tmp/cf/0eb670b1ff8446989a8d8d9a09517b47 as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/cf/0eb670b1ff8446989a8d8d9a09517b47 2023-09-13 21:01:29,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/cf/63a8fd14c9034f4491bcfee5c0ded72b, entries=1, sequenceid=5, filesize=4.7 K 2023-09-13 21:01:29,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 396cdce634c496b7f689070f27bf9d0c in 31ms, sequenceid=5, compaction requested=false 2023-09-13 21:01:29,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-13 21:01:29,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/cf/0eb670b1ff8446989a8d8d9a09517b47, entries=1, sequenceid=5, filesize=4.7 K 2023-09-13 21:01:29,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d1cf6d1a2eeee42e1a22036474eab35d in 32ms, sequenceid=5, compaction requested=false 2023-09-13 21:01:29,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-13 21:01:29,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-13 21:01:29,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:01:29,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c. 2023-09-13 21:01:29,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 396cdce634c496b7f689070f27bf9d0c: 2023-09-13 21:01:29,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:01:29,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d. 2023-09-13 21:01:29,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d1cf6d1a2eeee42e1a22036474eab35d: 2023-09-13 21:01:29,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:29,656 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=396cdce634c496b7f689070f27bf9d0c, regionState=CLOSED 2023-09-13 21:01:29,657 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694638889656"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638889656"}]},"ts":"1694638889656"} 2023-09-13 21:01:29,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:29,657 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=d1cf6d1a2eeee42e1a22036474eab35d, regionState=CLOSED 2023-09-13 21:01:29,657 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694638889657"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638889657"}]},"ts":"1694638889657"} 2023-09-13 21:01:29,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-13 21:01:29,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 396cdce634c496b7f689070f27bf9d0c, server=jenkins-hbase4.apache.org,43255,1694638816358 in 202 msec 2023-09-13 21:01:29,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-13 21:01:29,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure d1cf6d1a2eeee42e1a22036474eab35d, server=jenkins-hbase4.apache.org,42107,1694638816311 in 203 msec 2023-09-13 21:01:29,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=396cdce634c496b7f689070f27bf9d0c, UNASSIGN in 213 msec 2023-09-13 21:01:29,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-13 21:01:29,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d1cf6d1a2eeee42e1a22036474eab35d, UNASSIGN in 209 msec 2023-09-13 21:01:29,710 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-13 21:01:29,712 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888786.396cdce634c496b7f689070f27bf9d0c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:29,712 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694638888786.d1cf6d1a2eeee42e1a22036474eab35d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:29,712 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:29,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 21:01:29,762 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e937fa376cbad0347ef165b65341833a, ASSIGN}] 2023-09-13 21:01:29,763 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e937fa376cbad0347ef165b65341833a, ASSIGN 2023-09-13 21:01:29,763 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e937fa376cbad0347ef165b65341833a, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43255,1694638816358; forceNewPlan=false, retain=false 2023-09-13 21:01:29,914 INFO [jenkins-hbase4:33631] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-13 21:01:29,915 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e937fa376cbad0347ef165b65341833a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:29,916 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694638889915"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638889915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638889915"}]},"ts":"1694638889915"} 2023-09-13 21:01:29,917 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure e937fa376cbad0347ef165b65341833a, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:01:30,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 21:01:30,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a. 2023-09-13 21:01:30,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e937fa376cbad0347ef165b65341833a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a.', STARTKEY => '', ENDKEY => ''} 2023-09-13 21:01:30,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a. service=AccessControlService 2023-09-13 21:01:30,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:01:30,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e937fa376cbad0347ef165b65341833a 2023-09-13 21:01:30,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:30,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e937fa376cbad0347ef165b65341833a 2023-09-13 21:01:30,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e937fa376cbad0347ef165b65341833a 2023-09-13 21:01:30,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/.regioninfo 2023-09-13 21:01:30,082 INFO [StoreOpener-e937fa376cbad0347ef165b65341833a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e937fa376cbad0347ef165b65341833a 2023-09-13 21:01:30,083 DEBUG [StoreOpener-e937fa376cbad0347ef165b65341833a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/cf 2023-09-13 21:01:30,083 DEBUG [StoreOpener-e937fa376cbad0347ef165b65341833a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/cf 2023-09-13 21:01:30,083 INFO [StoreOpener-e937fa376cbad0347ef165b65341833a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e937fa376cbad0347ef165b65341833a columnFamilyName cf 2023-09-13 21:01:30,110 DEBUG [StoreOpener-e937fa376cbad0347ef165b65341833a-1] regionserver.HStore(539): loaded hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/cf/0eb670b1ff8446989a8d8d9a09517b47.d1cf6d1a2eeee42e1a22036474eab35d->hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/cf/0eb670b1ff8446989a8d8d9a09517b47-top 2023-09-13 21:01:30,115 DEBUG [StoreOpener-e937fa376cbad0347ef165b65341833a-1] regionserver.HStore(539): loaded hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/cf/63a8fd14c9034f4491bcfee5c0ded72b.396cdce634c496b7f689070f27bf9d0c->hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/cf/63a8fd14c9034f4491bcfee5c0ded72b-top 2023-09-13 21:01:30,115 INFO [StoreOpener-e937fa376cbad0347ef165b65341833a-1] regionserver.HStore(310): Store=e937fa376cbad0347ef165b65341833a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:01:30,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a 2023-09-13 21:01:30,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a 2023-09-13 21:01:30,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e937fa376cbad0347ef165b65341833a 2023-09-13 21:01:30,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e937fa376cbad0347ef165b65341833a; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64513823, jitterRate=-0.038669124245643616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:01:30,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e937fa376cbad0347ef165b65341833a: 2023-09-13 21:01:30,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a., pid=77, masterSystemTime=1694638890069 2023-09-13 21:01:30,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a.,because compaction is disabled. 2023-09-13 21:01:30,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a. 2023-09-13 21:01:30,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a. 2023-09-13 21:01:30,124 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e937fa376cbad0347ef165b65341833a, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,124 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694638890124"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638890124"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638890124"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638890124"}]},"ts":"1694638890124"} 2023-09-13 21:01:30,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-13 21:01:30,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure e937fa376cbad0347ef165b65341833a, server=jenkins-hbase4.apache.org,43255,1694638816358 in 208 msec 2023-09-13 21:01:30,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-13 21:01:30,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e937fa376cbad0347ef165b65341833a, ASSIGN in 365 msec 2023-09-13 21:01:30,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[396cdce634c496b7f689070f27bf9d0c, d1cf6d1a2eeee42e1a22036474eab35d], force=true in 707 msec 2023-09-13 21:01:30,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 21:01:30,537 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-13 21:01:30,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-13 21:01:30,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694638890538 (current time:1694638890538). 2023-09-13 21:01:30,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 21:01:30,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x7d278201 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:30,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26466315, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:30,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:30,549 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:30,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d278201 to 127.0.0.1:61376 2023-09-13 21:01:30,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:30,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x78e238dc to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:30,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39148a4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:30,558 DEBUG [hconnection-0x2c5f08b7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:30,560 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:30,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:30,566 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:30,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78e238dc to 127.0.0.1:61376 2023-09-13 21:01:30,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:30,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-13 21:01:30,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 21:01:30,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-13 21:01:30,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-13 21:01:30,571 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-13 21:01:30,571 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1694639490571 2023-09-13 21:01:30,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-13 21:01:30,571 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,575 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 21:01:30,575 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 21:01:30,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-13 21:01:30,576 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-13 21:01:30,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-13 21:01:30,578 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-13 21:01:30,578 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1694639490578 2023-09-13 21:01:30,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,589 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-13 21:01:30,590 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:30,591 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-13 21:01:30,591 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-13 21:01:30,591 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,591 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,593 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:30,593 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:30,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:30,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:30,593 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:30,593 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,593 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,593 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-13 21:01:30,595 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-13 21:01:30,595 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:30,594 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-13 21:01:30,596 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-13 21:01:30,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,596 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-13 21:01:30,596 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-13 21:01:30,596 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:30,596 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-13 21:01:30,597 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-13 21:01:30,597 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-13 21:01:30,597 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-13 21:01:30,596 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:30,597 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-13 21:01:30,598 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-13 21:01:30,598 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-13 21:01:30,598 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-13 21:01:30,600 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,601 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,601 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,601 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,601 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,601 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:30,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:30,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:30,601 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,601 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,601 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:30,601 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:30,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:30,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:30,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:30,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:30,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:30,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-13 21:01:30,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4568bc26[Count = 0] remaining members to acquire global barrier 2023-09-13 21:01:30,603 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-13 21:01:30,603 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,606 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,606 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,606 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,606 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,606 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 21:01:30,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,606 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-13 21:01:30,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,606 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-13 21:01:30,606 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-13 21:01:30,606 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-13 21:01:30,607 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44809,1694638816394' in zk 2023-09-13 21:01:30,606 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-13 21:01:30,607 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:01:30,607 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:01:30,607 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a. 2023-09-13 21:01:30,607 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42107,1694638816311' in zk 2023-09-13 21:01:30,607 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a. started... 2023-09-13 21:01:30,608 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e937fa376cbad0347ef165b65341833a: 2023-09-13 21:01:30,608 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,608 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:01:30,609 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/cf/0eb670b1ff8446989a8d8d9a09517b47.d1cf6d1a2eeee42e1a22036474eab35d->hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/cf/0eb670b1ff8446989a8d8d9a09517b47-top, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/cf/63a8fd14c9034f4491bcfee5c0ded72b.396cdce634c496b7f689070f27bf9d0c->hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/cf/63a8fd14c9034f4491bcfee5c0ded72b-top] hfiles 2023-09-13 21:01:30,609 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/cf/0eb670b1ff8446989a8d8d9a09517b47.d1cf6d1a2eeee42e1a22036474eab35d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,609 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/cf/63a8fd14c9034f4491bcfee5c0ded72b.396cdce634c496b7f689070f27bf9d0c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,609 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-13 21:01:30,609 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:30,609 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-13 21:01:30,611 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-13 21:01:30,611 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:30,611 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-13 21:01:30,621 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a. completed. 2023-09-13 21:01:30,621 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a. 2023-09-13 21:01:30,621 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:01:30,621 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:01:30,621 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,621 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-13 21:01:30,621 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43255,1694638816358' in zk 2023-09-13 21:01:30,627 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-13 21:01:30,627 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,627 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:30,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:30,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:30,627 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-13 21:01:30,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:30,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:30,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:30,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:30,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43255,1694638816358': 2023-09-13 21:01:30,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-13 21:01:30,630 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-13 21:01:30,630 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 21:01:30,630 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 21:01:30,630 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,630 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 21:01:30,632 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,632 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:30,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:30,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,632 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:30,632 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,632 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,633 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:30,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:30,633 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:30,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,633 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:30,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:30,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:30,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:30,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:30,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:30,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:30,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:30,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:30,634 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,635 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:30,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:30,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:30,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:30,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:30,636 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:30,637 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,637 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:30,640 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:30,640 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:30,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:30,640 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:30,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:30,640 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:30,640 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:30,640 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:30,640 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:30,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:30,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:30,640 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,640 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:30,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:30,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:30,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:30,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:30,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,640 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:30,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:30,641 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,641 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:30,641 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,641 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:30,641 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,641 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:30,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:30,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:30,641 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:30,641 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,641 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,661 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-13 21:01:30,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,662 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1694638890572Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694638890640 (+68 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694638890641 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694638890644 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694638890652 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1694638890661 (+9 ms) 2023-09-13 21:01:30,664 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-13 21:01:30,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 89 msec 2023-09-13 21:01:30,675 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:01:30,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-13 21:01:30,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 21:01:30,676 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638890676 2023-09-13 21:01:30,676 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45325, tgtDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638890676, rawTgtDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638890676, srcFsUri=hdfs://localhost:45325, srcDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:01:30,698 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:01:30,698 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1552854738_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638890676, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638890676/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,698 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19, snapshotDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-13 21:01:30,707 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638890676/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:30,725 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:30,725 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:30,726 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:30,726 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:31,615 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-6337859746816838952.jar 2023-09-13 21:01:31,615 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:31,616 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:31,681 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0004_000001 (auth:SIMPLE) 2023-09-13 21:01:31,692 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-2831024841908177513.jar 2023-09-13 21:01:31,692 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:31,693 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:31,693 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:31,693 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:31,694 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:31,694 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:31,694 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 21:01:31,695 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 21:01:31,695 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 21:01:31,695 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 21:01:31,696 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 21:01:31,696 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 21:01:31,696 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 21:01:31,697 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 21:01:31,697 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 21:01:31,698 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 21:01:31,698 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:31,698 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:31,699 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:01:31,699 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:31,699 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:31,700 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:01:31,700 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:01:32,088 WARN [Listener at jenkins-hbase4.apache.org/36385] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 21:01:32,090 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-13 21:01:32,092 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-13 21:01:32,143 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:01:32,144 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:01:32,412 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 21:01:32,683 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0005_000001 (auth:SIMPLE) 2023-09-13 21:01:36,342 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0005_000001 (auth:SIMPLE) 2023-09-13 21:01:38,547 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0005_000001 (auth:SIMPLE) 2023-09-13 21:01:41,288 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0005_000001 (auth:SIMPLE) 2023-09-13 21:01:43,244 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 21:01:43,247 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 21:01:43,256 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,256 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 21:01:43,257 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 21:01:43,257 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1883159808_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,257 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-13 21:01:43,257 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-13 21:01:43,257 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1883159808_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638890676/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638890676/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,258 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638890676/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-13 21:01:43,258 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638890676/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-13 21:01:43,264 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-13 21:01:43,269 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638903269"}]},"ts":"1694638903269"} 2023-09-13 21:01:43,270 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-13 21:01:43,272 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-13 21:01:43,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e937fa376cbad0347ef165b65341833a, UNASSIGN}] 2023-09-13 21:01:43,274 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e937fa376cbad0347ef165b65341833a, UNASSIGN 2023-09-13 21:01:43,275 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e937fa376cbad0347ef165b65341833a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:43,275 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694638903275"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638903275"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638903275"}]},"ts":"1694638903275"} 2023-09-13 21:01:43,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure e937fa376cbad0347ef165b65341833a, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:01:43,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-13 21:01:43,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e937fa376cbad0347ef165b65341833a 2023-09-13 21:01:43,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e937fa376cbad0347ef165b65341833a, disabling compactions & flushes 2023-09-13 21:01:43,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a. 2023-09-13 21:01:43,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a. 2023-09-13 21:01:43,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a. after waiting 0 ms 2023-09-13 21:01:43,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a. 2023-09-13 21:01:43,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-13 21:01:43,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:01:43,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a. 2023-09-13 21:01:43,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e937fa376cbad0347ef165b65341833a: 2023-09-13 21:01:43,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e937fa376cbad0347ef165b65341833a 2023-09-13 21:01:43,442 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e937fa376cbad0347ef165b65341833a, regionState=CLOSED 2023-09-13 21:01:43,442 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694638903442"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638903442"}]},"ts":"1694638903442"} 2023-09-13 21:01:43,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-13 21:01:43,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure e937fa376cbad0347ef165b65341833a, server=jenkins-hbase4.apache.org,43255,1694638816358 in 167 msec 2023-09-13 21:01:43,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-13 21:01:43,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e937fa376cbad0347ef165b65341833a, UNASSIGN in 173 msec 2023-09-13 21:01:43,447 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638903447"}]},"ts":"1694638903447"} 2023-09-13 21:01:43,448 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-13 21:01:43,449 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-13 21:01:43,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-09-13 21:01:43,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-13 21:01:43,571 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-13 21:01:43,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,575 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,576 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,577 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,580 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:43,580 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a 2023-09-13 21:01:43,580 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:43,581 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/recovered.edits] 2023-09-13 21:01:43,581 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/recovered.edits] 2023-09-13 21:01:43,582 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/recovered.edits] 2023-09-13 21:01:43,584 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,584 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,584 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,584 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,584 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-13 21:01:43,585 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-13 21:01:43,585 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,585 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,585 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:43,585 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-13 21:01:43,585 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:43,585 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-13 21:01:43,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-13 21:01:43,586 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-13 21:01:43,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:43,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-13 21:01:43,589 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/cf/0eb670b1ff8446989a8d8d9a09517b47 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/cf/0eb670b1ff8446989a8d8d9a09517b47 2023-09-13 21:01:43,589 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/cf/0eb670b1ff8446989a8d8d9a09517b47.d1cf6d1a2eeee42e1a22036474eab35d to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/cf/0eb670b1ff8446989a8d8d9a09517b47.d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:43,589 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/cf/63a8fd14c9034f4491bcfee5c0ded72b to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/cf/63a8fd14c9034f4491bcfee5c0ded72b 2023-09-13 21:01:43,590 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:43,590 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:43,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:43,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:43,591 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:43,591 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/cf/63a8fd14c9034f4491bcfee5c0ded72b.396cdce634c496b7f689070f27bf9d0c to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/cf/63a8fd14c9034f4491bcfee5c0ded72b.396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:43,593 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/recovered.edits/8.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d/recovered.edits/8.seqid 2023-09-13 21:01:43,594 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/recovered.edits/8.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c/recovered.edits/8.seqid 2023-09-13 21:01:43,594 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d1cf6d1a2eeee42e1a22036474eab35d 2023-09-13 21:01:43,594 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/396cdce634c496b7f689070f27bf9d0c 2023-09-13 21:01:43,595 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/recovered.edits/12.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a/recovered.edits/12.seqid 2023-09-13 21:01:43,595 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e937fa376cbad0347ef165b65341833a 2023-09-13 21:01:43,595 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-13 21:01:43,597 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,600 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-13 21:01:43,601 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-13 21:01:43,602 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,602 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-13 21:01:43,602 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694638903602"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:43,604 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-13 21:01:43,604 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e937fa376cbad0347ef165b65341833a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694638888787.e937fa376cbad0347ef165b65341833a.', STARTKEY => '', ENDKEY => ''}] 2023-09-13 21:01:43,604 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-13 21:01:43,604 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694638903604"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:43,605 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-13 21:01:43,607 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:43,608 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 35 msec 2023-09-13 21:01:43,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-13 21:01:43,688 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-13 21:01:43,688 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:43,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:43,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:43,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-13 21:01:43,693 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638903693"}]},"ts":"1694638903693"} 2023-09-13 21:01:43,695 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-13 21:01:43,696 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-13 21:01:43,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ece8640e5a4229c921bb2880d8a181d3, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20907fba32e76b38444845150e8c1250, UNASSIGN}] 2023-09-13 21:01:43,699 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ece8640e5a4229c921bb2880d8a181d3, UNASSIGN 2023-09-13 21:01:43,699 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20907fba32e76b38444845150e8c1250, UNASSIGN 2023-09-13 21:01:43,700 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ece8640e5a4229c921bb2880d8a181d3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:43,700 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694638903700"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638903700"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638903700"}]},"ts":"1694638903700"} 2023-09-13 21:01:43,700 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=20907fba32e76b38444845150e8c1250, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:43,700 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694638903700"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638903700"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638903700"}]},"ts":"1694638903700"} 2023-09-13 21:01:43,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure ece8640e5a4229c921bb2880d8a181d3, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:01:43,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 20907fba32e76b38444845150e8c1250, server=jenkins-hbase4.apache.org,44809,1694638816394}] 2023-09-13 21:01:43,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-13 21:01:43,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ece8640e5a4229c921bb2880d8a181d3 2023-09-13 21:01:43,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ece8640e5a4229c921bb2880d8a181d3, disabling compactions & flushes 2023-09-13 21:01:43,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:43,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:43,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. after waiting 0 ms 2023-09-13 21:01:43,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:43,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 20907fba32e76b38444845150e8c1250 2023-09-13 21:01:43,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 20907fba32e76b38444845150e8c1250, disabling compactions & flushes 2023-09-13 21:01:43,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:43,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:43,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. after waiting 0 ms 2023-09-13 21:01:43,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:43,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 21:01:43,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 21:01:43,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:01:43,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3. 2023-09-13 21:01:43,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ece8640e5a4229c921bb2880d8a181d3: 2023-09-13 21:01:43,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:01:43,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250. 2023-09-13 21:01:43,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 20907fba32e76b38444845150e8c1250: 2023-09-13 21:01:43,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ece8640e5a4229c921bb2880d8a181d3 2023-09-13 21:01:43,868 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ece8640e5a4229c921bb2880d8a181d3, regionState=CLOSED 2023-09-13 21:01:43,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 20907fba32e76b38444845150e8c1250 2023-09-13 21:01:43,869 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694638903868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638903868"}]},"ts":"1694638903868"} 2023-09-13 21:01:43,869 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=20907fba32e76b38444845150e8c1250, regionState=CLOSED 2023-09-13 21:01:43,869 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694638903869"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638903869"}]},"ts":"1694638903869"} 2023-09-13 21:01:43,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-13 21:01:43,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure ece8640e5a4229c921bb2880d8a181d3, server=jenkins-hbase4.apache.org,43255,1694638816358 in 169 msec 2023-09-13 21:01:43,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-13 21:01:43,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 20907fba32e76b38444845150e8c1250, server=jenkins-hbase4.apache.org,44809,1694638816394 in 169 msec 2023-09-13 21:01:43,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ece8640e5a4229c921bb2880d8a181d3, UNASSIGN in 175 msec 2023-09-13 21:01:43,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-13 21:01:43,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20907fba32e76b38444845150e8c1250, UNASSIGN in 175 msec 2023-09-13 21:01:43,874 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638903874"}]},"ts":"1694638903874"} 2023-09-13 21:01:43,875 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-13 21:01:43,878 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-13 21:01:43,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 189 msec 2023-09-13 21:01:43,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-13 21:01:43,996 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-13 21:01:43,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:43,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:43,999 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,000 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,001 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,004 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,004 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,004 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,004 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,004 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-13 21:01:44,004 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-13 21:01:44,004 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3 2023-09-13 21:01:44,004 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-13 21:01:44,004 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-13 21:01:44,004 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250 2023-09-13 21:01:44,005 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,005 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,005 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:44,005 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,005 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,005 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:44,005 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:44,005 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:44,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-13 21:01:44,007 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/recovered.edits] 2023-09-13 21:01:44,007 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/recovered.edits] 2023-09-13 21:01:44,010 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/cf/682277869e8c4e27b62bc6204bd5e511 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/cf/682277869e8c4e27b62bc6204bd5e511 2023-09-13 21:01:44,011 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/cf/12d19bc8c97f43a3a8bad79b87b94030 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/cf/12d19bc8c97f43a3a8bad79b87b94030 2023-09-13 21:01:44,013 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/recovered.edits/9.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3/recovered.edits/9.seqid 2023-09-13 21:01:44,014 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/recovered.edits/9.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250/recovered.edits/9.seqid 2023-09-13 21:01:44,014 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ece8640e5a4229c921bb2880d8a181d3 2023-09-13 21:01:44,014 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20907fba32e76b38444845150e8c1250 2023-09-13 21:01:44,014 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-13 21:01:44,015 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-13 21:01:44,016 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-13 21:01:44,019 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091380fb7fed9f29413ab23729170263c480 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091380fb7fed9f29413ab23729170263c480 2023-09-13 21:01:44,020 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230913edd4d21abfde4269baabb7618996411e to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230913edd4d21abfde4269baabb7618996411e 2023-09-13 21:01:44,021 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-13 21:01:44,023 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,025 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-13 21:01:44,026 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-13 21:01:44,027 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,027 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-13 21:01:44,028 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694638904027"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:44,028 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694638904027"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:44,029 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 21:01:44,029 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ece8640e5a4229c921bb2880d8a181d3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694638887114.ece8640e5a4229c921bb2880d8a181d3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 20907fba32e76b38444845150e8c1250, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694638887114.20907fba32e76b38444845150e8c1250.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 21:01:44,029 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-13 21:01:44,029 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694638904029"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:44,031 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-13 21:01:44,033 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 36 msec 2023-09-13 21:01:44,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-13 21:01:44,108 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-13 21:01:44,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-13 21:01:44,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-13 21:01:44,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 21:01:44,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-13 21:01:44,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 21:01:44,146 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 752) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1883159808_17 at /127.0.0.1:56726 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1883159808_17 at /127.0.0.1:45018 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1883159808_17 at /127.0.0.1:36156 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_71863893_1 at /127.0.0.1:56692 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4070 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:37265 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 202) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=8585 (was 8586) 2023-09-13 21:01:44,147 WARN [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-13 21:01:44,165 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=227, ProcessCount=171, AvailableMemoryMB=8583 2023-09-13 21:01:44,165 WARN [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-13 21:01:44,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 21:01:44,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 21:01:44,170 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 21:01:44,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-13 21:01:44,170 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 21:01:44,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-13 21:01:44,172 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20 2023-09-13 21:01:44,172 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc 2023-09-13 21:01:44,173 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20 empty. 2023-09-13 21:01:44,173 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc empty. 2023-09-13 21:01:44,173 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20 2023-09-13 21:01:44,173 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc 2023-09-13 21:01:44,174 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-13 21:01:44,182 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-13 21:01:44,183 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => bfe3fbd128ea386338539e6d344bfb20, NAME => 'testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:01:44,183 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e18c05e264c0222774389c84646196fc, NAME => 'testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:01:44,191 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:44,191 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e18c05e264c0222774389c84646196fc, disabling compactions & flushes 2023-09-13 21:01:44,191 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:44,191 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:44,191 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. after waiting 0 ms 2023-09-13 21:01:44,191 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:44,191 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:44,191 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:44,191 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing bfe3fbd128ea386338539e6d344bfb20, disabling compactions & flushes 2023-09-13 21:01:44,191 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e18c05e264c0222774389c84646196fc: 2023-09-13 21:01:44,191 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:44,191 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:44,191 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. after waiting 0 ms 2023-09-13 21:01:44,191 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:44,191 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:44,191 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for bfe3fbd128ea386338539e6d344bfb20: 2023-09-13 21:01:44,193 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 21:01:44,194 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694638904193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638904193"}]},"ts":"1694638904193"} 2023-09-13 21:01:44,194 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694638904193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638904193"}]},"ts":"1694638904193"} 2023-09-13 21:01:44,195 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 21:01:44,196 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 21:01:44,196 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638904196"}]},"ts":"1694638904196"} 2023-09-13 21:01:44,197 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-13 21:01:44,200 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 21:01:44,201 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 21:01:44,201 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 21:01:44,201 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 21:01:44,201 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 21:01:44,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bfe3fbd128ea386338539e6d344bfb20, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e18c05e264c0222774389c84646196fc, ASSIGN}] 2023-09-13 21:01:44,204 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bfe3fbd128ea386338539e6d344bfb20, ASSIGN 2023-09-13 21:01:44,204 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e18c05e264c0222774389c84646196fc, ASSIGN 2023-09-13 21:01:44,204 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bfe3fbd128ea386338539e6d344bfb20, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42107,1694638816311; forceNewPlan=false, retain=false 2023-09-13 21:01:44,204 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e18c05e264c0222774389c84646196fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44809,1694638816394; forceNewPlan=false, retain=false 2023-09-13 21:01:44,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-13 21:01:44,355 INFO [jenkins-hbase4:33631] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 21:01:44,357 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e18c05e264c0222774389c84646196fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,357 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=bfe3fbd128ea386338539e6d344bfb20, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,358 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694638904357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638904357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638904357"}]},"ts":"1694638904357"} 2023-09-13 21:01:44,358 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694638904357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638904357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638904357"}]},"ts":"1694638904357"} 2023-09-13 21:01:44,359 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure e18c05e264c0222774389c84646196fc, server=jenkins-hbase4.apache.org,44809,1694638816394}] 2023-09-13 21:01:44,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure bfe3fbd128ea386338539e6d344bfb20, server=jenkins-hbase4.apache.org,42107,1694638816311}] 2023-09-13 21:01:44,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-13 21:01:44,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:44,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e18c05e264c0222774389c84646196fc, NAME => 'testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 21:01:44,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. service=AccessControlService 2023-09-13 21:01:44,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:01:44,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:44,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState e18c05e264c0222774389c84646196fc 2023-09-13 21:01:44,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bfe3fbd128ea386338539e6d344bfb20, NAME => 'testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 21:01:44,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:44,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e18c05e264c0222774389c84646196fc 2023-09-13 21:01:44,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e18c05e264c0222774389c84646196fc 2023-09-13 21:01:44,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. service=AccessControlService 2023-09-13 21:01:44,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:01:44,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState bfe3fbd128ea386338539e6d344bfb20 2023-09-13 21:01:44,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:44,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bfe3fbd128ea386338539e6d344bfb20 2023-09-13 21:01:44,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bfe3fbd128ea386338539e6d344bfb20 2023-09-13 21:01:44,523 INFO [StoreOpener-e18c05e264c0222774389c84646196fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e18c05e264c0222774389c84646196fc 2023-09-13 21:01:44,523 INFO [StoreOpener-bfe3fbd128ea386338539e6d344bfb20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bfe3fbd128ea386338539e6d344bfb20 2023-09-13 21:01:44,524 DEBUG [StoreOpener-e18c05e264c0222774389c84646196fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/cf 2023-09-13 21:01:44,524 DEBUG [StoreOpener-e18c05e264c0222774389c84646196fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/cf 2023-09-13 21:01:44,524 DEBUG [StoreOpener-bfe3fbd128ea386338539e6d344bfb20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/cf 2023-09-13 21:01:44,524 DEBUG [StoreOpener-bfe3fbd128ea386338539e6d344bfb20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/cf 2023-09-13 21:01:44,525 INFO [StoreOpener-e18c05e264c0222774389c84646196fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e18c05e264c0222774389c84646196fc columnFamilyName cf 2023-09-13 21:01:44,525 INFO [StoreOpener-bfe3fbd128ea386338539e6d344bfb20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfe3fbd128ea386338539e6d344bfb20 columnFamilyName cf 2023-09-13 21:01:44,526 INFO [StoreOpener-e18c05e264c0222774389c84646196fc-1] regionserver.HStore(310): Store=e18c05e264c0222774389c84646196fc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:01:44,526 INFO [StoreOpener-bfe3fbd128ea386338539e6d344bfb20-1] regionserver.HStore(310): Store=bfe3fbd128ea386338539e6d344bfb20/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:01:44,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20 2023-09-13 21:01:44,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc 2023-09-13 21:01:44,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20 2023-09-13 21:01:44,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc 2023-09-13 21:01:44,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bfe3fbd128ea386338539e6d344bfb20 2023-09-13 21:01:44,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e18c05e264c0222774389c84646196fc 2023-09-13 21:01:44,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:01:44,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:01:44,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bfe3fbd128ea386338539e6d344bfb20; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69151247, jitterRate=0.030433878302574158}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:01:44,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e18c05e264c0222774389c84646196fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74444979, jitterRate=0.1093166321516037}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:01:44,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bfe3fbd128ea386338539e6d344bfb20: 2023-09-13 21:01:44,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e18c05e264c0222774389c84646196fc: 2023-09-13 21:01:44,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc., pid=93, masterSystemTime=1694638904511 2023-09-13 21:01:44,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20., pid=94, masterSystemTime=1694638904511 2023-09-13 21:01:44,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:44,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:44,535 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e18c05e264c0222774389c84646196fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,535 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694638904535"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638904535"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638904535"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638904535"}]},"ts":"1694638904535"} 2023-09-13 21:01:44,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:44,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:44,535 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=bfe3fbd128ea386338539e6d344bfb20, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,535 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694638904535"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638904535"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638904535"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638904535"}]},"ts":"1694638904535"} 2023-09-13 21:01:44,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-13 21:01:44,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure e18c05e264c0222774389c84646196fc, server=jenkins-hbase4.apache.org,44809,1694638816394 in 177 msec 2023-09-13 21:01:44,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-13 21:01:44,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure bfe3fbd128ea386338539e6d344bfb20, server=jenkins-hbase4.apache.org,42107,1694638816311 in 177 msec 2023-09-13 21:01:44,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e18c05e264c0222774389c84646196fc, ASSIGN in 337 msec 2023-09-13 21:01:44,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-13 21:01:44,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bfe3fbd128ea386338539e6d344bfb20, ASSIGN in 337 msec 2023-09-13 21:01:44,540 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 21:01:44,540 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638904540"}]},"ts":"1694638904540"} 2023-09-13 21:01:44,541 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-13 21:01:44,543 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 21:01:44,544 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-13 21:01:44,545 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 21:01:44,552 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:44,552 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:44,552 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:44,552 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:44,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:44,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:44,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:44,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:44,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 386 msec 2023-09-13 21:01:44,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-13 21:01:44,774 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-13 21:01:44,776 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-13 21:01:44,776 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:44,778 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 21:01:44,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 21:01:44,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694638904788 (current time:1694638904788). 2023-09-13 21:01:44,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 21:01:44,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x71b93ad0 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:44,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71bca58d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:44,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:44,800 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:44,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71b93ad0 to 127.0.0.1:61376 2023-09-13 21:01:44,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:44,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x279cebfc to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:44,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fcb2a65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:44,809 DEBUG [hconnection-0xb4f64dc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:44,812 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:44,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:44,817 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:44,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x279cebfc to 127.0.0.1:61376 2023-09-13 21:01:44,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:44,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 21:01:44,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 21:01:44,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 21:01:44,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 21:01:44,822 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 21:01:44,822 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694639504822 2023-09-13 21:01:44,822 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-13 21:01:44,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 21:01:44,823 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 21:01:44,824 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 21:01:44,824 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 21:01:44,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 21:01:44,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-13 21:01:44,828 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 21:01:44,829 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694639504829 2023-09-13 21:01:44,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,841 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-13 21:01:44,841 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:44,842 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-13 21:01:44,842 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-13 21:01:44,843 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,843 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,850 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:44,850 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:44,850 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:44,850 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:44,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:44,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:44,850 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:44,850 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:44,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:44,851 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,851 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 21:01:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-13 21:01:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-13 21:01:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,852 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 21:01:44,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-13 21:01:44,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,852 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 21:01:44,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,852 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 21:01:44,852 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 21:01:44,852 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:44,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,852 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 21:01:44,852 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:44,854 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 21:01:44,854 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,854 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 21:01:44,854 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 21:01:44,854 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 21:01:44,854 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 21:01:44,854 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 21:01:44,854 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 21:01:44,854 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:44,856 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 21:01:44,856 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 21:01:44,856 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 21:01:44,857 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,857 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,857 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:44,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:44,858 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,858 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,858 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,859 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,859 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:44,859 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:44,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:44,859 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,859 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:44,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:44,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:44,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:44,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-13 21:01:44,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fab1e26[Count = 1] remaining members to acquire global barrier 2023-09-13 21:01:44,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:44,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:44,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:44,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:44,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:44,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:44,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-13 21:01:44,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fab1e26[Count = 0] remaining members to acquire global barrier 2023-09-13 21:01:44,863 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-13 21:01:44,863 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,865 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,865 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,865 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,865 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,865 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 21:01:44,865 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,866 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 21:01:44,866 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:01:44,866 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:01:44,866 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:44,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,866 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. started... 2023-09-13 21:01:44,866 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 21:01:44,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,866 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 21:01:44,866 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bfe3fbd128ea386338539e6d344bfb20: 2023-09-13 21:01:44,866 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 21:01:44,866 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:01:44,866 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:01:44,866 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:44,866 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43255,1694638816358' in zk 2023-09-13 21:01:44,866 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. started... 2023-09-13 21:01:44,866 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,866 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:01:44,868 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e18c05e264c0222774389c84646196fc: 2023-09-13 21:01:44,868 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 21:01:44,868 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,868 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:01:44,868 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 21:01:44,870 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 21:01:44,870 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:44,870 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 21:01:44,887 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. completed. 2023-09-13 21:01:44,887 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. completed. 2023-09-13 21:01:44,887 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:44,887 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:01:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:01:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:01:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:01:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 21:01:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,888 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42107,1694638816311' in zk 2023-09-13 21:01:44,888 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 21:01:44,888 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44809,1694638816394' in zk 2023-09-13 21:01:44,889 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 21:01:44,889 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,889 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:44,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:44,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:44,889 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 21:01:44,889 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 21:01:44,889 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,891 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:44,891 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 21:01:44,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42107,1694638816311': 2023-09-13 21:01:44,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-13 21:01:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:44,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:44,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44809,1694638816394': 2023-09-13 21:01:44,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-13 21:01:44,898 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-13 21:01:44,898 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 21:01:44,898 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 21:01:44,898 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,898 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 21:01:44,899 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,899 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:44,899 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:44,900 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,900 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:44,900 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:44,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,900 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:44,900 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,900 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:44,901 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:44,902 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,903 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:44,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:44,903 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:44,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,906 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,906 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,907 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:44,907 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:44,907 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,907 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:44,907 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:44,907 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,907 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,907 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:44,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:44,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:44,907 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:44,907 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-13 21:01:44,907 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:44,907 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:44,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:44,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:44,907 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:44,907 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:44,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 21:01:44,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:44,908 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:44,908 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:44,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:44,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:44,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:44,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:44,908 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:44,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:44,909 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 21:01:44,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,924 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:01:44,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 21:01:44,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 21:01:44,926 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 21:01:44,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,931 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-13 21:01:44,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,931 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:44,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694638904822Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694638904915 (+93 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694638904915Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1694638904915Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1694638904919 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694638904926 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694638904931 (+5 ms) 2023-09-13 21:01:44,935 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 21:01:44,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 112 msec 2023-09-13 21:01:45,126 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:01:45,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 21:01:45,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 21:01:45,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42107] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 21:01:45,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44809] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 21:01:45,132 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-13 21:01:45,132 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:45,133 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 21:01:45,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 21:01:45,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694638905141 (current time:1694638905141). 2023-09-13 21:01:45,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 21:01:45,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x0e5caa47 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:45,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ca56ca3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:45,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:45,151 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:45,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e5caa47 to 127.0.0.1:61376 2023-09-13 21:01:45,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:45,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x53ab927a to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:45,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38ce04da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:45,158 DEBUG [hconnection-0x7f49b714-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:45,159 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:45,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:45,163 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:45,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53ab927a to 127.0.0.1:61376 2023-09-13 21:01:45,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:45,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 21:01:45,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 21:01:45,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 21:01:45,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 21:01:45,168 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 21:01:45,168 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694639505168 2023-09-13 21:01:45,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 21:01:45,168 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-13 21:01:45,169 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 21:01:45,170 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 21:01:45,170 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 21:01:45,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 21:01:45,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-13 21:01:45,172 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 21:01:45,172 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694639505172 2023-09-13 21:01:45,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,180 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-13 21:01:45,180 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:45,181 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-13 21:01:45,181 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-13 21:01:45,182 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,182 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,183 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:45,183 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:45,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:45,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:45,183 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:45,183 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,183 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,184 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,184 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,184 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 21:01:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-13 21:01:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-13 21:01:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-13 21:01:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,184 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 21:01:45,184 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 21:01:45,184 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 21:01:45,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,185 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 21:01:45,185 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 21:01:45,185 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:45,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 21:01:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 21:01:45,185 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 21:01:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 21:01:45,187 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:45,187 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 21:01:45,190 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 21:01:45,190 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 21:01:45,190 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 21:01:45,190 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 21:01:45,190 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 21:01:45,191 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,191 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:45,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:45,192 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,192 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,192 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:45,192 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,192 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:45,192 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,192 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:45,193 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,193 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:45,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-13 21:01:45,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257ee0b[Count = 1] remaining members to acquire global barrier 2023-09-13 21:01:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:45,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-13 21:01:45,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257ee0b[Count = 0] remaining members to acquire global barrier 2023-09-13 21:01:45,196 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-13 21:01:45,196 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,202 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,202 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,202 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,202 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,202 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 21:01:45,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,202 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 21:01:45,202 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 21:01:45,202 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 21:01:45,202 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43255,1694638816358' in zk 2023-09-13 21:01:45,202 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:01:45,202 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,202 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:45,202 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 21:01:45,202 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:01:45,202 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:01:45,203 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:01:45,202 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:45,202 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. started... 2023-09-13 21:01:45,203 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. started... 2023-09-13 21:01:45,203 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bfe3fbd128ea386338539e6d344bfb20 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-13 21:01:45,203 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e18c05e264c0222774389c84646196fc 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-13 21:01:45,204 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 21:01:45,204 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:45,204 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 21:01:45,220 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309135da1bd5966164d24ac1e6a16a2cf4650 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309135da1bd5966164d24ac1e6a16a2cf4650 2023-09-13 21:01:45,222 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230913997494b12b27426c8c11c0fad4dae175 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230913997494b12b27426c8c11c0fad4dae175 2023-09-13 21:01:45,236 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/.tmp/cf/1f07d8416b4644d889e5f6cfb2043aaa 2023-09-13 21:01:45,238 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/.tmp/cf/6d9a95a03ac94a2ca431fb2619558071 2023-09-13 21:01:45,241 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/.tmp/cf/1f07d8416b4644d889e5f6cfb2043aaa as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/cf/1f07d8416b4644d889e5f6cfb2043aaa 2023-09-13 21:01:45,243 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/.tmp/cf/6d9a95a03ac94a2ca431fb2619558071 as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/cf/6d9a95a03ac94a2ca431fb2619558071 2023-09-13 21:01:45,246 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/cf/1f07d8416b4644d889e5f6cfb2043aaa, entries=4, sequenceid=6, filesize=5.6 K 2023-09-13 21:01:45,247 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for bfe3fbd128ea386338539e6d344bfb20 in 44ms, sequenceid=6, compaction requested=false 2023-09-13 21:01:45,247 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-13 21:01:45,247 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bfe3fbd128ea386338539e6d344bfb20: 2023-09-13 21:01:45,247 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,248 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:01:45,248 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/cf/1f07d8416b4644d889e5f6cfb2043aaa] hfiles 2023-09-13 21:01:45,248 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/cf/1f07d8416b4644d889e5f6cfb2043aaa for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,248 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/cf/6d9a95a03ac94a2ca431fb2619558071, entries=46, sequenceid=6, filesize=12.9 K 2023-09-13 21:01:45,249 INFO [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for e18c05e264c0222774389c84646196fc in 46ms, sequenceid=6, compaction requested=false 2023-09-13 21:01:45,251 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e18c05e264c0222774389c84646196fc: 2023-09-13 21:01:45,251 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,251 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:01:45,251 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/cf/6d9a95a03ac94a2ca431fb2619558071] hfiles 2023-09-13 21:01:45,251 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/cf/6d9a95a03ac94a2ca431fb2619558071 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,259 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. completed. 2023-09-13 21:01:45,259 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:45,259 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:01:45,259 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:01:45,259 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,259 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 21:01:45,259 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42107,1694638816311' in zk 2023-09-13 21:01:45,260 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. completed. 2023-09-13 21:01:45,260 DEBUG [rs(jenkins-hbase4.apache.org,44809,1694638816394)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:45,260 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:01:45,260 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:01:45,260 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,260 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 21:01:45,260 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44809,1694638816394' in zk 2023-09-13 21:01:45,261 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,261 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 21:01:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:45,261 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:45,261 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 21:01:45,263 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:45,263 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 21:01:45,263 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:45,263 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 21:01:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:45,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42107,1694638816311': 2023-09-13 21:01:45,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-13 21:01:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:45,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:45,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:45,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44809,1694638816394': 2023-09-13 21:01:45,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-13 21:01:45,269 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-13 21:01:45,269 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 21:01:45,269 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 21:01:45,269 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,269 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 21:01:45,270 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:01:45,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 21:01:45,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 21:01:45,271 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 21:01:45,277 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,277 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:45,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:45,277 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:45,277 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,277 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:45,277 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:45,277 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,277 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:45,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:45,278 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:45,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,279 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,280 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,280 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:45,280 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,283 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,283 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,283 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:45,283 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:45,283 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:45,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:45,283 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:45,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:45,283 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:45,283 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:45,283 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,283 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-13 21:01:45,283 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:45,283 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:45,283 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:45,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,283 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:45,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:45,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:45,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:45,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:45,283 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:45,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:45,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:45,285 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 21:01:45,285 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:45,285 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:45,285 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,285 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:45,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:45,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230913997494b12b27426c8c11c0fad4dae175, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309135da1bd5966164d24ac1e6a16a2cf4650] mob files 2023-09-13 21:01:45,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230913997494b12b27426c8c11c0fad4dae175 2023-09-13 21:01:45,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309135da1bd5966164d24ac1e6a16a2cf4650 2023-09-13 21:01:45,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,308 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-13 21:01:45,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,309 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694638905168Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694638905293 (+125 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1694638905293Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1694638905293Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1694638905296 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1694638905302 (+6 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694638905308 (+6 ms) 2023-09-13 21:01:45,313 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 21:01:45,315 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 144 msec 2023-09-13 21:01:45,472 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:01:45,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 21:01:45,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 21:01:45,473 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638905473 2023-09-13 21:01:45,473 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45325, tgtDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638905473, rawTgtDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638905473, srcFsUri=hdfs://localhost:45325, srcDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:01:45,495 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:01:45,495 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-496538846_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638905473, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638905473/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,495 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19, snapshotDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-13 21:01:45,500 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638905473/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:45,920 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:45,921 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:45,921 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:45,921 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:46,799 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-3665531248569474939.jar 2023-09-13 21:01:46,800 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:46,800 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:46,867 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-8109038820936828050.jar 2023-09-13 21:01:46,867 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:46,868 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:46,868 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:46,868 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:46,869 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:46,869 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:46,869 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 21:01:46,870 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 21:01:46,870 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 21:01:46,871 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 21:01:46,871 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 21:01:46,871 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 21:01:46,872 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 21:01:46,872 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 21:01:46,872 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 21:01:46,873 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 21:01:46,873 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:46,874 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:46,874 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:01:46,875 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:46,875 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:46,875 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:01:46,876 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:01:47,218 WARN [Listener at jenkins-hbase4.apache.org/36385] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 21:01:47,220 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-13 21:01:47,475 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:01:47,475 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:01:47,481 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0005_000001 (auth:SIMPLE) 2023-09-13 21:01:47,936 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0006_000001 (auth:SIMPLE) 2023-09-13 21:01:49,034 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 21:01:51,637 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0006_000001 (auth:SIMPLE) 2023-09-13 21:01:54,587 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 21:01:54,588 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 21:01:54,592 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:54,592 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 21:01:54,593 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 21:01:54,593 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1883159808_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:54,593 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-13 21:01:54,593 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-13 21:01:54,594 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1883159808_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638905473/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638905473/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:54,594 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638905473/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-13 21:01:54,594 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638905473/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-13 21:01:54,599 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-13 21:01:54,603 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638914603"}]},"ts":"1694638914603"} 2023-09-13 21:01:54,604 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-13 21:01:54,606 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-13 21:01:54,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bfe3fbd128ea386338539e6d344bfb20, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e18c05e264c0222774389c84646196fc, UNASSIGN}] 2023-09-13 21:01:54,609 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e18c05e264c0222774389c84646196fc, UNASSIGN 2023-09-13 21:01:54,609 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bfe3fbd128ea386338539e6d344bfb20, UNASSIGN 2023-09-13 21:01:54,609 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e18c05e264c0222774389c84646196fc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:54,609 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=bfe3fbd128ea386338539e6d344bfb20, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:54,609 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694638914609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638914609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638914609"}]},"ts":"1694638914609"} 2023-09-13 21:01:54,609 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694638914609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638914609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638914609"}]},"ts":"1694638914609"} 2023-09-13 21:01:54,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure e18c05e264c0222774389c84646196fc, server=jenkins-hbase4.apache.org,44809,1694638816394}] 2023-09-13 21:01:54,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure bfe3fbd128ea386338539e6d344bfb20, server=jenkins-hbase4.apache.org,42107,1694638816311}] 2023-09-13 21:01:54,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-13 21:01:54,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bfe3fbd128ea386338539e6d344bfb20 2023-09-13 21:01:54,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e18c05e264c0222774389c84646196fc 2023-09-13 21:01:54,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bfe3fbd128ea386338539e6d344bfb20, disabling compactions & flushes 2023-09-13 21:01:54,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e18c05e264c0222774389c84646196fc, disabling compactions & flushes 2023-09-13 21:01:54,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:54,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:54,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:54,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:54,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. after waiting 0 ms 2023-09-13 21:01:54,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:54,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. after waiting 0 ms 2023-09-13 21:01:54,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:54,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 21:01:54,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 21:01:54,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:01:54,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:01:54,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20. 2023-09-13 21:01:54,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc. 2023-09-13 21:01:54,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bfe3fbd128ea386338539e6d344bfb20: 2023-09-13 21:01:54,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e18c05e264c0222774389c84646196fc: 2023-09-13 21:01:54,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bfe3fbd128ea386338539e6d344bfb20 2023-09-13 21:01:54,774 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=bfe3fbd128ea386338539e6d344bfb20, regionState=CLOSED 2023-09-13 21:01:54,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e18c05e264c0222774389c84646196fc 2023-09-13 21:01:54,774 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694638914774"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638914774"}]},"ts":"1694638914774"} 2023-09-13 21:01:54,775 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e18c05e264c0222774389c84646196fc, regionState=CLOSED 2023-09-13 21:01:54,775 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694638914775"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638914775"}]},"ts":"1694638914775"} 2023-09-13 21:01:54,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-13 21:01:54,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure bfe3fbd128ea386338539e6d344bfb20, server=jenkins-hbase4.apache.org,42107,1694638816311 in 165 msec 2023-09-13 21:01:54,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-13 21:01:54,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure e18c05e264c0222774389c84646196fc, server=jenkins-hbase4.apache.org,44809,1694638816394 in 166 msec 2023-09-13 21:01:54,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bfe3fbd128ea386338539e6d344bfb20, UNASSIGN in 171 msec 2023-09-13 21:01:54,779 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-13 21:01:54,779 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e18c05e264c0222774389c84646196fc, UNASSIGN in 172 msec 2023-09-13 21:01:54,780 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638914780"}]},"ts":"1694638914780"} 2023-09-13 21:01:54,781 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-13 21:01:54,783 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-13 21:01:54,784 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 184 msec 2023-09-13 21:01:54,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-13 21:01:54,905 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-13 21:01:54,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,909 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,909 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,911 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,913 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20 2023-09-13 21:01:54,913 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc 2023-09-13 21:01:54,914 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,914 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,914 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,914 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-13 21:01:54,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-13 21:01:54,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-13 21:01:54,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-13 21:01:54,916 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/recovered.edits] 2023-09-13 21:01:54,916 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/recovered.edits] 2023-09-13 21:01:54,916 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,916 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:54,916 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,916 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,916 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,916 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:54,916 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:54,916 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:54,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-13 21:01:54,925 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/cf/6d9a95a03ac94a2ca431fb2619558071 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/cf/6d9a95a03ac94a2ca431fb2619558071 2023-09-13 21:01:54,925 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/cf/1f07d8416b4644d889e5f6cfb2043aaa to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/cf/1f07d8416b4644d889e5f6cfb2043aaa 2023-09-13 21:01:54,928 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/recovered.edits/9.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc/recovered.edits/9.seqid 2023-09-13 21:01:54,928 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/recovered.edits/9.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20/recovered.edits/9.seqid 2023-09-13 21:01:54,928 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/e18c05e264c0222774389c84646196fc 2023-09-13 21:01:54,928 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testEmptyExportFileSystemState/bfe3fbd128ea386338539e6d344bfb20 2023-09-13 21:01:54,928 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-13 21:01:54,929 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-13 21:01:54,929 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-13 21:01:54,932 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230913997494b12b27426c8c11c0fad4dae175 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230913997494b12b27426c8c11c0fad4dae175 2023-09-13 21:01:54,933 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309135da1bd5966164d24ac1e6a16a2cf4650 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309135da1bd5966164d24ac1e6a16a2cf4650 2023-09-13 21:01:54,934 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-13 21:01:54,936 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,937 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-13 21:01:54,939 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-13 21:01:54,940 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,940 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-13 21:01:54,940 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694638914940"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:54,940 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694638914940"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:54,942 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 21:01:54,942 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bfe3fbd128ea386338539e6d344bfb20, NAME => 'testtb-testEmptyExportFileSystemState,,1694638904167.bfe3fbd128ea386338539e6d344bfb20.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e18c05e264c0222774389c84646196fc, NAME => 'testtb-testEmptyExportFileSystemState,1,1694638904167.e18c05e264c0222774389c84646196fc.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 21:01:54,942 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-13 21:01:54,942 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694638914942"}]},"ts":"9223372036854775807"} 2023-09-13 21:01:54,944 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-13 21:01:54,946 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 21:01:54,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 40 msec 2023-09-13 21:01:55,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-13 21:01:55,018 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-13 21:01:55,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-13 21:01:55,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:55,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-13 21:01:55,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-13 21:01:55,054 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 758) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1883159808_17 at /127.0.0.1:56302 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1981898476_1 at /127.0.0.1:42748 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4722 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:35265 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:37177 from appattempt_1694638822764_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1567643461) connection to jenkins-hbase4.apache.org/172.31.14.131:43279 from appattempt_1694638822764_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1883159808_17 at /127.0.0.1:42782 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1883159808_17 at /127.0.0.1:38382 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1981898476_1 at /127.0.0.1:56294 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5590acd6-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=945 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=217 (was 227), ProcessCount=171 (was 171), AvailableMemoryMB=8499 (was 8583) 2023-09-13 21:01:55,055 WARN [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-13 21:01:55,075 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=945, MaxFileDescriptor=60000, SystemLoadAverage=217, ProcessCount=171, AvailableMemoryMB=8498 2023-09-13 21:01:55,075 WARN [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-13 21:01:55,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 21:01:55,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,080 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 21:01:55,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-13 21:01:55,081 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 21:01:55,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-13 21:01:55,083 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb 2023-09-13 21:01:55,083 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b 2023-09-13 21:01:55,083 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb empty. 2023-09-13 21:01:55,083 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b empty. 2023-09-13 21:01:55,084 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb 2023-09-13 21:01:55,084 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b 2023-09-13 21:01:55,084 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-13 21:01:55,093 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-13 21:01:55,094 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4ff2c43bc4e4fbf8a97e5d4a24b4aefb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:01:55,095 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5b845b1e96b72958e2e9239f0b24d14b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp 2023-09-13 21:01:55,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:55,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:55,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 5b845b1e96b72958e2e9239f0b24d14b, disabling compactions & flushes 2023-09-13 21:01:55,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 4ff2c43bc4e4fbf8a97e5d4a24b4aefb, disabling compactions & flushes 2023-09-13 21:01:55,108 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:01:55,108 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:01:55,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:01:55,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:01:55,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. after waiting 0 ms 2023-09-13 21:01:55,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:01:55,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. after waiting 0 ms 2023-09-13 21:01:55,108 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:01:55,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:01:55,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 5b845b1e96b72958e2e9239f0b24d14b: 2023-09-13 21:01:55,108 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:01:55,108 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 4ff2c43bc4e4fbf8a97e5d4a24b4aefb: 2023-09-13 21:01:55,111 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 21:01:55,112 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694638915112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638915112"}]},"ts":"1694638915112"} 2023-09-13 21:01:55,112 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694638915112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638915112"}]},"ts":"1694638915112"} 2023-09-13 21:01:55,114 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 21:01:55,115 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 21:01:55,115 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638915115"}]},"ts":"1694638915115"} 2023-09-13 21:01:55,116 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-13 21:01:55,123 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-13 21:01:55,124 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 21:01:55,124 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 21:01:55,124 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 21:01:55,124 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 21:01:55,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ff2c43bc4e4fbf8a97e5d4a24b4aefb, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b845b1e96b72958e2e9239f0b24d14b, ASSIGN}] 2023-09-13 21:01:55,127 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b845b1e96b72958e2e9239f0b24d14b, ASSIGN 2023-09-13 21:01:55,127 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ff2c43bc4e4fbf8a97e5d4a24b4aefb, ASSIGN 2023-09-13 21:01:55,127 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b845b1e96b72958e2e9239f0b24d14b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42107,1694638816311; forceNewPlan=false, retain=false 2023-09-13 21:01:55,127 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ff2c43bc4e4fbf8a97e5d4a24b4aefb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43255,1694638816358; forceNewPlan=false, retain=false 2023-09-13 21:01:55,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-13 21:01:55,278 INFO [jenkins-hbase4:33631] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 21:01:55,280 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4ff2c43bc4e4fbf8a97e5d4a24b4aefb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,280 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=5b845b1e96b72958e2e9239f0b24d14b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,280 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694638915280"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638915280"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638915280"}]},"ts":"1694638915280"} 2023-09-13 21:01:55,280 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694638915280"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638915280"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638915280"}]},"ts":"1694638915280"} 2023-09-13 21:01:55,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 4ff2c43bc4e4fbf8a97e5d4a24b4aefb, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:01:55,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 5b845b1e96b72958e2e9239f0b24d14b, server=jenkins-hbase4.apache.org,42107,1694638816311}] 2023-09-13 21:01:55,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-13 21:01:55,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:01:55,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4ff2c43bc4e4fbf8a97e5d4a24b4aefb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 21:01:55,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. service=AccessControlService 2023-09-13 21:01:55,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:01:55,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:01:55,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b845b1e96b72958e2e9239f0b24d14b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 21:01:55,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 4ff2c43bc4e4fbf8a97e5d4a24b4aefb 2023-09-13 21:01:55,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:55,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4ff2c43bc4e4fbf8a97e5d4a24b4aefb 2023-09-13 21:01:55,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4ff2c43bc4e4fbf8a97e5d4a24b4aefb 2023-09-13 21:01:55,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. service=AccessControlService 2023-09-13 21:01:55,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 21:01:55,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 5b845b1e96b72958e2e9239f0b24d14b 2023-09-13 21:01:55,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 21:01:55,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5b845b1e96b72958e2e9239f0b24d14b 2023-09-13 21:01:55,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5b845b1e96b72958e2e9239f0b24d14b 2023-09-13 21:01:55,438 INFO [StoreOpener-4ff2c43bc4e4fbf8a97e5d4a24b4aefb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4ff2c43bc4e4fbf8a97e5d4a24b4aefb 2023-09-13 21:01:55,438 INFO [StoreOpener-5b845b1e96b72958e2e9239f0b24d14b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b845b1e96b72958e2e9239f0b24d14b 2023-09-13 21:01:55,439 DEBUG [StoreOpener-4ff2c43bc4e4fbf8a97e5d4a24b4aefb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/cf 2023-09-13 21:01:55,439 DEBUG [StoreOpener-4ff2c43bc4e4fbf8a97e5d4a24b4aefb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/cf 2023-09-13 21:01:55,439 DEBUG [StoreOpener-5b845b1e96b72958e2e9239f0b24d14b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/cf 2023-09-13 21:01:55,439 DEBUG [StoreOpener-5b845b1e96b72958e2e9239f0b24d14b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/cf 2023-09-13 21:01:55,440 INFO [StoreOpener-4ff2c43bc4e4fbf8a97e5d4a24b4aefb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ff2c43bc4e4fbf8a97e5d4a24b4aefb columnFamilyName cf 2023-09-13 21:01:55,440 INFO [StoreOpener-5b845b1e96b72958e2e9239f0b24d14b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b845b1e96b72958e2e9239f0b24d14b columnFamilyName cf 2023-09-13 21:01:55,441 INFO [StoreOpener-4ff2c43bc4e4fbf8a97e5d4a24b4aefb-1] regionserver.HStore(310): Store=4ff2c43bc4e4fbf8a97e5d4a24b4aefb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:01:55,441 INFO [StoreOpener-5b845b1e96b72958e2e9239f0b24d14b-1] regionserver.HStore(310): Store=5b845b1e96b72958e2e9239f0b24d14b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 21:01:55,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb 2023-09-13 21:01:55,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b 2023-09-13 21:01:55,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb 2023-09-13 21:01:55,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b 2023-09-13 21:01:55,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4ff2c43bc4e4fbf8a97e5d4a24b4aefb 2023-09-13 21:01:55,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5b845b1e96b72958e2e9239f0b24d14b 2023-09-13 21:01:55,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:01:55,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 21:01:55,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4ff2c43bc4e4fbf8a97e5d4a24b4aefb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69430486, jitterRate=0.03459486365318298}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:01:55,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4ff2c43bc4e4fbf8a97e5d4a24b4aefb: 2023-09-13 21:01:55,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5b845b1e96b72958e2e9239f0b24d14b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69490710, jitterRate=0.035492271184921265}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 21:01:55,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5b845b1e96b72958e2e9239f0b24d14b: 2023-09-13 21:01:55,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb., pid=108, masterSystemTime=1694638915433 2023-09-13 21:01:55,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b., pid=109, masterSystemTime=1694638915434 2023-09-13 21:01:55,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:01:55,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:01:55,450 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4ff2c43bc4e4fbf8a97e5d4a24b4aefb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:01:55,450 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694638915450"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638915450"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638915450"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638915450"}]},"ts":"1694638915450"} 2023-09-13 21:01:55,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:01:55,450 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=5b845b1e96b72958e2e9239f0b24d14b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,450 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694638915450"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694638915450"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694638915450"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694638915450"}]},"ts":"1694638915450"} 2023-09-13 21:01:55,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-13 21:01:55,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 4ff2c43bc4e4fbf8a97e5d4a24b4aefb, server=jenkins-hbase4.apache.org,43255,1694638816358 in 169 msec 2023-09-13 21:01:55,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-13 21:01:55,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 5b845b1e96b72958e2e9239f0b24d14b, server=jenkins-hbase4.apache.org,42107,1694638816311 in 170 msec 2023-09-13 21:01:55,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ff2c43bc4e4fbf8a97e5d4a24b4aefb, ASSIGN in 329 msec 2023-09-13 21:01:55,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-13 21:01:55,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b845b1e96b72958e2e9239f0b24d14b, ASSIGN in 329 msec 2023-09-13 21:01:55,455 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 21:01:55,455 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638915455"}]},"ts":"1694638915455"} 2023-09-13 21:01:55,456 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-13 21:01:55,458 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 21:01:55,458 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-13 21:01:55,460 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-13 21:01:55,461 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:55,461 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:55,461 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:55,461 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:01:55,463 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:55,463 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:55,463 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:55,463 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-13 21:01:55,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 386 msec 2023-09-13 21:01:55,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-13 21:01:55,684 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-13 21:01:55,686 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,686 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:01:55,688 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 21:01:55,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 21:01:55,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694638915697 (current time:1694638915697). 2023-09-13 21:01:55,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 21:01:55,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x7092bcf5 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:55,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1875c9b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:55,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:55,711 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:55,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7092bcf5 to 127.0.0.1:61376 2023-09-13 21:01:55,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:55,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x5981492c to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:55,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c9133fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:55,719 DEBUG [hconnection-0xa9f4d8d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:55,722 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:55,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:55,727 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:55,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5981492c to 127.0.0.1:61376 2023-09-13 21:01:55,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:55,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-13 21:01:55,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 21:01:55,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 21:01:55,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 21:01:55,732 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 21:01:55,732 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694639515732 2023-09-13 21:01:55,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 21:01:55,732 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,733 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 21:01:55,734 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 21:01:55,734 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 21:01:55,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 21:01:55,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-13 21:01:55,736 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 21:01:55,736 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694639515736 2023-09-13 21:01:55,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,745 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-13 21:01:55,745 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:55,745 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-13 21:01:55,745 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-13 21:01:55,746 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,746 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,748 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:55,748 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:55,748 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:55,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:55,748 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:55,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:55,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:55,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:55,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:55,749 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,749 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,749 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,749 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 21:01:55,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-13 21:01:55,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-13 21:01:55,750 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 21:01:55,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-13 21:01:55,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,750 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 21:01:55,750 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 21:01:55,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 21:01:55,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 21:01:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:55,751 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 21:01:55,752 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 21:01:55,752 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 21:01:55,752 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 21:01:55,752 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 21:01:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 21:01:55,752 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 21:01:55,752 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:55,753 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 21:01:55,753 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 21:01:55,753 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 21:01:55,759 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,759 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:55,759 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,759 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,760 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,760 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:55,760 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,760 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:55,760 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:55,760 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,760 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:55,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-13 21:01:55,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a257153[Count = 1] remaining members to acquire global barrier 2023-09-13 21:01:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:55,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-13 21:01:55,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a257153[Count = 0] remaining members to acquire global barrier 2023-09-13 21:01:55,763 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-13 21:01:55,763 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,765 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,765 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,765 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,765 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 21:01:55,765 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,765 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 21:01:55,765 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 21:01:55,765 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:01:55,765 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:01:55,765 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:01:55,765 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,765 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 21:01:55,765 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:01:55,765 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 21:01:55,765 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. started... 2023-09-13 21:01:55,765 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. started... 2023-09-13 21:01:55,765 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:01:55,766 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:01:55,766 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b845b1e96b72958e2e9239f0b24d14b: 2023-09-13 21:01:55,766 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4ff2c43bc4e4fbf8a97e5d4a24b4aefb: 2023-09-13 21:01:55,766 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44809,1694638816394' in zk 2023-09-13 21:01:55,767 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,767 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:01:55,767 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 21:01:55,767 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,767 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:01:55,767 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 21:01:55,770 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 21:01:55,770 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:55,770 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 21:01:55,785 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. completed. 2023-09-13 21:01:55,785 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:01:55,786 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:01:55,786 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:01:55,786 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,786 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 21:01:55,786 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43255,1694638816358' in zk 2023-09-13 21:01:55,787 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 21:01:55,787 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,787 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:55,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:55,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:55,787 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. completed. 2023-09-13 21:01:55,787 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 21:01:55,789 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:01:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:01:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:01:55,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 21:01:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42107,1694638816311' in zk 2023-09-13 21:01:55,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:55,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,791 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,791 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 21:01:55,791 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:55,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,791 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 21:01:55,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:55,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43255,1694638816358': 2023-09-13 21:01:55,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-13 21:01:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:55,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42107,1694638816311': 2023-09-13 21:01:55,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-13 21:01:55,797 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-13 21:01:55,797 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 21:01:55,797 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 21:01:55,797 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,797 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 21:01:55,798 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,798 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,798 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,798 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:55,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:55,798 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,798 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:55,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,799 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:55,799 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:55,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:55,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,799 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:55,800 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:55,801 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,802 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,802 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,806 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,806 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:55,806 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:55,806 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:55,806 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,806 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:55,806 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,806 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:55,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:55,806 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:55,806 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:55,806 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:55,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:55,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:55,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,807 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:55,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 21:01:55,807 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:55,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:55,808 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,808 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,808 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,808 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,808 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,808 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:55,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:55,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 21:01:55,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,833 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-13 21:01:55,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,834 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:01:55,834 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694638915733Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694638915814 (+81 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694638915814Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694638915814Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694638915818 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694638915827 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694638915833 (+6 ms) 2023-09-13 21:01:55,836 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 21:01:55,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-13 21:01:55,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 21:01:55,838 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 103 msec 2023-09-13 21:01:55,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42107] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 21:01:55,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43255] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 21:01:55,844 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,845 DEBUG [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:01:55,845 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 21:01:55,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 21:01:55,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694638915854 (current time:1694638915854). 2023-09-13 21:01:55,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 21:01:55,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x1681f602 to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:55,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6602327a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:55,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:55,862 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43050, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:55,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1681f602 to 127.0.0.1:61376 2023-09-13 21:01:55,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:55,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(139): Connect 0x6a6d39cf to 127.0.0.1:61376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 21:01:55,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73c5f366, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 21:01:55,870 DEBUG [hconnection-0x4a38e86-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:55,876 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:55,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 21:01:55,882 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 21:01:55,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a6d39cf to 127.0.0.1:61376 2023-09-13 21:01:55,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:01:55,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-13 21:01:55,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 21:01:55,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 21:01:55,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 21:01:55,887 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 21:01:55,887 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694639515887 2023-09-13 21:01:55,887 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 21:01:55,888 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 21:01:55,889 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 21:01:55,889 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 21:01:55,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 21:01:55,890 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-13 21:01:55,891 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 21:01:55,892 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694639515892 2023-09-13 21:01:55,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,899 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-13 21:01:55,899 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:55,900 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-13 21:01:55,900 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-13 21:01:55,901 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,901 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,902 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:55,902 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:55,902 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:55,902 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:55,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:55,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:55,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:55,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:55,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:55,902 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,902 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,903 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,903 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 21:01:55,903 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 21:01:55,904 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 21:01:55,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,904 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 21:01:55,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,904 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 21:01:55,904 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 21:01:55,904 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:55,904 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:55,905 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 21:01:55,906 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 21:01:55,906 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 21:01:55,906 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 21:01:55,906 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 21:01:55,906 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44809,1694638816394' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 21:01:55,904 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 21:01:55,907 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 21:01:55,907 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 21:01:55,907 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 21:01:55,908 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,908 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:55,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:55,909 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,909 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,909 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:55,909 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,909 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:55,909 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,909 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,909 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:55,909 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 21:01:55,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:55,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:55,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43255,1694638816358' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-13 21:01:55,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a2c71bd[Count = 1] remaining members to acquire global barrier 2023-09-13 21:01:55,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:55,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:55,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:55,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:55,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:55,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42107,1694638816311' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-13 21:01:55,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a2c71bd[Count = 0] remaining members to acquire global barrier 2023-09-13 21:01:55,913 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-13 21:01:55,913 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,918 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,918 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,918 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,918 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 21:01:55,918 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 21:01:55,918 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 21:01:55,918 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,918 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 21:01:55,918 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:01:55,919 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:01:55,919 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 21:01:55,918 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44809,1694638816394' in zk 2023-09-13 21:01:55,919 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:01:55,919 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 21:01:55,919 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:01:55,919 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,919 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 21:01:55,919 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. started... 2023-09-13 21:01:55,919 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. started... 2023-09-13 21:01:55,919 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4ff2c43bc4e4fbf8a97e5d4a24b4aefb 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-13 21:01:55,919 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b845b1e96b72958e2e9239f0b24d14b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-13 21:01:55,920 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 21:01:55,920 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:55,920 DEBUG [member: 'jenkins-hbase4.apache.org,44809,1694638816394' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 21:01:55,938 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230913794c02bd2c3d4760a6604d57e01218cf to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230913794c02bd2c3d4760a6604d57e01218cf 2023-09-13 21:01:55,940 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309132a119be021f94e99af1ad9ee212dbed2 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309132a119be021f94e99af1ad9ee212dbed2 2023-09-13 21:01:55,945 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/.tmp/cf/0ba93da8340440d2b76782e1e620e9eb 2023-09-13 21:01:55,946 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/.tmp/cf/cfe0a78b7d6c414aa0769847b87fb9c9 2023-09-13 21:01:55,949 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/.tmp/cf/0ba93da8340440d2b76782e1e620e9eb as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/cf/0ba93da8340440d2b76782e1e620e9eb 2023-09-13 21:01:55,950 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/.tmp/cf/cfe0a78b7d6c414aa0769847b87fb9c9 as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/cf/cfe0a78b7d6c414aa0769847b87fb9c9 2023-09-13 21:01:55,953 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/cf/0ba93da8340440d2b76782e1e620e9eb, entries=4, sequenceid=6, filesize=5.6 K 2023-09-13 21:01:55,954 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/cf/cfe0a78b7d6c414aa0769847b87fb9c9, entries=46, sequenceid=6, filesize=13.2 K 2023-09-13 21:01:55,954 INFO [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 4ff2c43bc4e4fbf8a97e5d4a24b4aefb in 35ms, sequenceid=6, compaction requested=false 2023-09-13 21:01:55,954 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-13 21:01:55,955 INFO [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 5b845b1e96b72958e2e9239f0b24d14b in 35ms, sequenceid=6, compaction requested=false 2023-09-13 21:01:55,955 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-13 21:01:55,956 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4ff2c43bc4e4fbf8a97e5d4a24b4aefb: 2023-09-13 21:01:55,956 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b845b1e96b72958e2e9239f0b24d14b: 2023-09-13 21:01:55,956 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,956 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,956 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:01:55,956 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 21:01:55,956 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/cf/0ba93da8340440d2b76782e1e620e9eb] hfiles 2023-09-13 21:01:55,956 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/cf/cfe0a78b7d6c414aa0769847b87fb9c9] hfiles 2023-09-13 21:01:55,956 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/cf/0ba93da8340440d2b76782e1e620e9eb for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,956 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/cf/cfe0a78b7d6c414aa0769847b87fb9c9 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,963 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. completed. 2023-09-13 21:01:55,963 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. completed. 2023-09-13 21:01:55,963 DEBUG [rs(jenkins-hbase4.apache.org,42107,1694638816311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:01:55,963 DEBUG [rs(jenkins-hbase4.apache.org,43255,1694638816358)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:01:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:01:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 21:01:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:01:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 21:01:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 21:01:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43255,1694638816358' in zk 2023-09-13 21:01:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 21:01:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42107,1694638816311' in zk 2023-09-13 21:01:55,965 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,965 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 21:01:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,965 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:55,965 DEBUG [member: 'jenkins-hbase4.apache.org,43255,1694638816358' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 21:01:55,966 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,966 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 21:01:55,966 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:55,966 DEBUG [member: 'jenkins-hbase4.apache.org,42107,1694638816311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 21:01:55,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:55,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:55,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:55,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43255,1694638816358': 2023-09-13 21:01:55,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43255,1694638816358' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-13 21:01:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42107,1694638816311': 2023-09-13 21:01:55,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42107,1694638816311' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-13 21:01:55,973 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-13 21:01:55,973 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 21:01:55,973 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 21:01:55,973 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,973 INFO [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 21:01:55,976 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,976 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 21:01:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 21:01:55,976 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,976 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,976 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:55,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,976 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:55,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,976 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,976 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 21:01:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:55,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:55,977 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,977 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 21:01:55,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,979 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 21:01:55,979 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,979 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,982 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,982 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,982 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,982 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:55,982 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:55,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:55,982 DEBUG [(jenkins-hbase4.apache.org,33631,1694638815069)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 21:01:55,982 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:55,982 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:55,982 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,982 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 21:01:55,983 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,983 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 21:01:55,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:55,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:55,982 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 21:01:55,983 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:55,983 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:01:55,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 21:01:55,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:55,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 21:01:55,984 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:55,984 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:01:55,984 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:01:55,984 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,984 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 21:01:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 21:01:55,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309132a119be021f94e99af1ad9ee212dbed2, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230913794c02bd2c3d4760a6604d57e01218cf] mob files 2023-09-13 21:01:55,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309132a119be021f94e99af1ad9ee212dbed2 2023-09-13 21:01:55,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230913794c02bd2c3d4760a6604d57e01218cf 2023-09-13 21:01:55,989 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:01:55,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-13 21:01:55,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-13 21:01:55,990 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 21:01:55,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:55,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:56,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:56,006 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-13 21:01:56,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:56,006 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:56,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694638915887Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694638915991 (+104 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694638915991Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1694638915991Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1694638915993 (+2 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694638916000 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694638916006 (+6 ms) 2023-09-13 21:01:56,009 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 21:01:56,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 121 msec 2023-09-13 21:01:56,190 DEBUG [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 21:01:56,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-13 21:01:56,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 21:01:56,191 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638916191 2023-09-13 21:01:56,191 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45325, tgtDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638916191, rawTgtDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638916191, srcFsUri=hdfs://localhost:45325, srcDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:01:56,212 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19 2023-09-13 21:01:56,212 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2039700424_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638916191, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638916191/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:56,212 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45325, inputRoot=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19, snapshotDir=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-13 21:01:56,220 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638916191/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:01:56,234 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:56,234 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:56,235 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:56,235 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:57,118 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-3920353820501752797.jar 2023-09-13 21:01:57,119 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:57,119 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:57,186 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/hadoop-7942949558850892409.jar 2023-09-13 21:01:57,186 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:57,186 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:57,187 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:57,187 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:57,188 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:57,188 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 21:01:57,188 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 21:01:57,189 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 21:01:57,189 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 21:01:57,189 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 21:01:57,190 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 21:01:57,190 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 21:01:57,190 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 21:01:57,191 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 21:01:57,191 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 21:01:57,191 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 21:01:57,192 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:57,192 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:57,193 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:01:57,193 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:57,193 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 21:01:57,194 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:01:57,194 DEBUG [Listener at jenkins-hbase4.apache.org/36385] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 21:01:57,540 WARN [Listener at jenkins-hbase4.apache.org/36385] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 21:01:57,542 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-13 21:01:57,544 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-13 21:01:58,938 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:01:58,938 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 21:01:58,944 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0006_000001 (auth:SIMPLE) 2023-09-13 21:01:59,485 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0007_000001 (auth:SIMPLE) 2023-09-13 21:02:00,362 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 21:02:03,114 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0007_000001 (auth:SIMPLE) 2023-09-13 21:02:05,318 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0007_000001 (auth:SIMPLE) 2023-09-13 21:02:07,859 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0007_000001 (auth:SIMPLE) 2023-09-13 21:02:09,711 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 21:02:09,711 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 21:02:09,722 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:09,722 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 21:02:09,723 INFO [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 21:02:09,723 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1883159808_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:09,723 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-13 21:02:09,723 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-13 21:02:09,723 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1883159808_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638916191/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638916191/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:09,724 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638916191/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-13 21:02:09,724 DEBUG [Listener at jenkins-hbase4.apache.org/36385] snapshot.TestExportSnapshot(367): hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/export-test/export-1694638916191/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-13 21:02:09,729 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:09,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:09,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:09,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-13 21:02:09,733 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638929733"}]},"ts":"1694638929733"} 2023-09-13 21:02:09,734 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-13 21:02:09,736 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-13 21:02:09,736 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ff2c43bc4e4fbf8a97e5d4a24b4aefb, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b845b1e96b72958e2e9239f0b24d14b, UNASSIGN}] 2023-09-13 21:02:09,738 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ff2c43bc4e4fbf8a97e5d4a24b4aefb, UNASSIGN 2023-09-13 21:02:09,738 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b845b1e96b72958e2e9239f0b24d14b, UNASSIGN 2023-09-13 21:02:09,738 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4ff2c43bc4e4fbf8a97e5d4a24b4aefb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:02:09,738 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=5b845b1e96b72958e2e9239f0b24d14b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:02:09,739 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694638929738"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638929738"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638929738"}]},"ts":"1694638929738"} 2023-09-13 21:02:09,739 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694638929738"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694638929738"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694638929738"}]},"ts":"1694638929738"} 2023-09-13 21:02:09,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 4ff2c43bc4e4fbf8a97e5d4a24b4aefb, server=jenkins-hbase4.apache.org,43255,1694638816358}] 2023-09-13 21:02:09,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 5b845b1e96b72958e2e9239f0b24d14b, server=jenkins-hbase4.apache.org,42107,1694638816311}] 2023-09-13 21:02:09,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-13 21:02:09,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4ff2c43bc4e4fbf8a97e5d4a24b4aefb 2023-09-13 21:02:09,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5b845b1e96b72958e2e9239f0b24d14b 2023-09-13 21:02:09,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4ff2c43bc4e4fbf8a97e5d4a24b4aefb, disabling compactions & flushes 2023-09-13 21:02:09,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5b845b1e96b72958e2e9239f0b24d14b, disabling compactions & flushes 2023-09-13 21:02:09,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:02:09,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:02:09,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:02:09,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:02:09,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. after waiting 0 ms 2023-09-13 21:02:09,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:02:09,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. after waiting 0 ms 2023-09-13 21:02:09,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:02:09,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 21:02:09,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 21:02:09,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:02:09,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:02:09,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb. 2023-09-13 21:02:09,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b. 2023-09-13 21:02:09,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4ff2c43bc4e4fbf8a97e5d4a24b4aefb: 2023-09-13 21:02:09,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5b845b1e96b72958e2e9239f0b24d14b: 2023-09-13 21:02:09,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4ff2c43bc4e4fbf8a97e5d4a24b4aefb 2023-09-13 21:02:09,907 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4ff2c43bc4e4fbf8a97e5d4a24b4aefb, regionState=CLOSED 2023-09-13 21:02:09,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5b845b1e96b72958e2e9239f0b24d14b 2023-09-13 21:02:09,907 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694638929907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638929907"}]},"ts":"1694638929907"} 2023-09-13 21:02:09,907 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=5b845b1e96b72958e2e9239f0b24d14b, regionState=CLOSED 2023-09-13 21:02:09,907 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694638929907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694638929907"}]},"ts":"1694638929907"} 2023-09-13 21:02:09,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-13 21:02:09,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 4ff2c43bc4e4fbf8a97e5d4a24b4aefb, server=jenkins-hbase4.apache.org,43255,1694638816358 in 168 msec 2023-09-13 21:02:09,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-13 21:02:09,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 5b845b1e96b72958e2e9239f0b24d14b, server=jenkins-hbase4.apache.org,42107,1694638816311 in 169 msec 2023-09-13 21:02:09,911 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ff2c43bc4e4fbf8a97e5d4a24b4aefb, UNASSIGN in 174 msec 2023-09-13 21:02:09,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-13 21:02:09,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5b845b1e96b72958e2e9239f0b24d14b, UNASSIGN in 174 msec 2023-09-13 21:02:09,912 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694638929912"}]},"ts":"1694638929912"} 2023-09-13 21:02:09,913 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-13 21:02:09,915 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-13 21:02:09,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 185 msec 2023-09-13 21:02:10,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-13 21:02:10,035 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-13 21:02:10,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,039 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,039 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,040 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42107] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,043 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb 2023-09-13 21:02:10,043 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b 2023-09-13 21:02:10,044 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,044 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,044 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,044 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,045 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/recovered.edits] 2023-09-13 21:02:10,045 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/cf, FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/recovered.edits] 2023-09-13 21:02:10,045 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-13 21:02:10,045 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-13 21:02:10,045 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-13 21:02:10,046 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,046 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,046 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:02:10,046 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:02:10,046 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,046 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-09-13 21:02:10,046 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:02:10,046 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-13 21:02:10,046 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 21:02:10,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-13 21:02:10,049 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/cf/0ba93da8340440d2b76782e1e620e9eb to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/cf/0ba93da8340440d2b76782e1e620e9eb 2023-09-13 21:02:10,049 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/cf/cfe0a78b7d6c414aa0769847b87fb9c9 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/cf/cfe0a78b7d6c414aa0769847b87fb9c9 2023-09-13 21:02:10,052 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/recovered.edits/9.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb/recovered.edits/9.seqid 2023-09-13 21:02:10,052 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/recovered.edits/9.seqid to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b/recovered.edits/9.seqid 2023-09-13 21:02:10,053 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ff2c43bc4e4fbf8a97e5d4a24b4aefb 2023-09-13 21:02:10,053 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5b845b1e96b72958e2e9239f0b24d14b 2023-09-13 21:02:10,053 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-13 21:02:10,053 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-13 21:02:10,054 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-13 21:02:10,057 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309132a119be021f94e99af1ad9ee212dbed2 to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309132a119be021f94e99af1ad9ee212dbed2 2023-09-13 21:02:10,058 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230913794c02bd2c3d4760a6604d57e01218cf to hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230913794c02bd2c3d4760a6604d57e01218cf 2023-09-13 21:02:10,058 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-13 21:02:10,060 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,062 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-13 21:02:10,063 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-13 21:02:10,064 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,064 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-13 21:02:10,064 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694638930064"}]},"ts":"9223372036854775807"} 2023-09-13 21:02:10,064 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694638930064"}]},"ts":"9223372036854775807"} 2023-09-13 21:02:10,066 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 21:02:10,066 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4ff2c43bc4e4fbf8a97e5d4a24b4aefb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694638915077.4ff2c43bc4e4fbf8a97e5d4a24b4aefb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5b845b1e96b72958e2e9239f0b24d14b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694638915077.5b845b1e96b72958e2e9239f0b24d14b.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 21:02:10,066 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-13 21:02:10,066 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694638930066"}]},"ts":"9223372036854775807"} 2023-09-13 21:02:10,068 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-13 21:02:10,069 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 33 msec 2023-09-13 21:02:10,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-13 21:02:10,148 INFO [Listener at jenkins-hbase4.apache.org/36385] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-13 21:02:10,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-13 21:02:10,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-13 21:02:10,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33631] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 21:02:10,185 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 766), OpenFileDescriptor=910 (was 945), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 217), ProcessCount=169 (was 171), AvailableMemoryMB=8426 (was 8498) 2023-09-13 21:02:10,185 WARN [Listener at jenkins-hbase4.apache.org/36385] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-13 21:02:10,185 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-13 21:02:10,194 INFO [Listener at jenkins-hbase4.apache.org/36385] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-13 21:02:14,034 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694638822764_0007_000001 (auth:SIMPLE) 2023-09-13 21:02:15,471 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 21:02:24,322 INFO [Listener at jenkins-hbase4.apache.org/36385] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-13 21:02:38,441 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-13 21:02:38,442 INFO [Listener at jenkins-hbase4.apache.org/36385] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-13 21:02:38,553 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-13 21:02:38,565 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-13 21:02:38,566 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-13 21:02:38,576 INFO [Listener at jenkins-hbase4.apache.org/36385] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-13 21:02:38,680 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-13 21:02:38,680 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-13 21:02:38,680 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-13 21:02:38,680 INFO [Listener at jenkins-hbase4.apache.org/36385] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-13 21:02:38,680 DEBUG [Listener at jenkins-hbase4.apache.org/36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52492d35 to 127.0.0.1:61376 2023-09-13 21:02:38,680 DEBUG [Listener at jenkins-hbase4.apache.org/36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:02:38,680 DEBUG [Listener at jenkins-hbase4.apache.org/36385] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-13 21:02:38,681 DEBUG [Listener at jenkins-hbase4.apache.org/36385] util.JVMClusterUtil(257): Found active master hash=701658575, stopped=false 2023-09-13 21:02:38,681 DEBUG [Listener at jenkins-hbase4.apache.org/36385] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:02:38,681 DEBUG [Listener at jenkins-hbase4.apache.org/36385] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-13 21:02:38,681 INFO [Listener at jenkins-hbase4.apache.org/36385] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33631,1694638815069 2023-09-13 21:02:38,682 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-13 21:02:38,682 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-13 21:02:38,682 INFO [Listener at jenkins-hbase4.apache.org/36385] procedure2.ProcedureExecutor(628): Stopping 2023-09-13 21:02:38,682 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-13 21:02:38,683 DEBUG [Listener at jenkins-hbase4.apache.org/36385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1581a3df to 127.0.0.1:61376 2023-09-13 21:02:38,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 21:02:38,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 21:02:38,682 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-13 21:02:38,683 DEBUG [Listener at jenkins-hbase4.apache.org/36385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:02:38,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 21:02:38,683 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 21:02:38,683 INFO [Listener at jenkins-hbase4.apache.org/36385] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42107,1694638816311' ***** 2023-09-13 21:02:38,683 DEBUG [Listener at jenkins-hbase4.apache.org/36385] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:02:38,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 21:02:38,684 INFO [Listener at jenkins-hbase4.apache.org/36385] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-13 21:02:38,684 INFO [Listener at jenkins-hbase4.apache.org/36385] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43255,1694638816358' ***** 2023-09-13 21:02:38,684 DEBUG [Listener at jenkins-hbase4.apache.org/36385] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:02:38,684 INFO [Listener at jenkins-hbase4.apache.org/36385] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-13 21:02:38,684 INFO [RS:0;jenkins-hbase4:42107] regionserver.HeapMemoryManager(220): Stopping 2023-09-13 21:02:38,684 INFO [Listener at jenkins-hbase4.apache.org/36385] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44809,1694638816394' ***** 2023-09-13 21:02:38,684 INFO [RS:1;jenkins-hbase4:43255] regionserver.HeapMemoryManager(220): Stopping 2023-09-13 21:02:38,684 DEBUG [Listener at jenkins-hbase4.apache.org/36385] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:02:38,684 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-13 21:02:38,684 INFO [RS:1;jenkins-hbase4:43255] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-13 21:02:38,684 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-13 21:02:38,684 INFO [RS:1;jenkins-hbase4:43255] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-13 21:02:38,684 INFO [RS:0;jenkins-hbase4:42107] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-13 21:02:38,684 INFO [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:02:38,684 INFO [Listener at jenkins-hbase4.apache.org/36385] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-13 21:02:38,685 DEBUG [RS:1;jenkins-hbase4:43255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f4290a1 to 127.0.0.1:61376 2023-09-13 21:02:38,684 INFO [RS:0;jenkins-hbase4:42107] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-13 21:02:38,685 DEBUG [RS:1;jenkins-hbase4:43255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:02:38,685 INFO [RS:2;jenkins-hbase4:44809] regionserver.HeapMemoryManager(220): Stopping 2023-09-13 21:02:38,687 INFO [RS:1;jenkins-hbase4:43255] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-13 21:02:38,687 INFO [RS:2;jenkins-hbase4:44809] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-13 21:02:38,687 INFO [RS:1;jenkins-hbase4:43255] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-13 21:02:38,687 INFO [RS:1;jenkins-hbase4:43255] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-13 21:02:38,687 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-13 21:02:38,687 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(3305): Received CLOSE for 6581cac807262776d608b6587b7b41b8 2023-09-13 21:02:38,687 INFO [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-13 21:02:38,687 INFO [RS:2;jenkins-hbase4:44809] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-13 21:02:38,688 INFO [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(3305): Received CLOSE for 1a7fc3008ef22f78d576b5eff38bc7af 2023-09-13 21:02:38,688 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:02:38,688 INFO [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:02:38,688 DEBUG [RS:0;jenkins-hbase4:42107] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b2e4d2a to 127.0.0.1:61376 2023-09-13 21:02:38,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1a7fc3008ef22f78d576b5eff38bc7af, disabling compactions & flushes 2023-09-13 21:02:38,689 DEBUG [RS:0;jenkins-hbase4:42107] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:02:38,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6581cac807262776d608b6587b7b41b8, disabling compactions & flushes 2023-09-13 21:02:38,690 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-13 21:02:38,688 DEBUG [RS:2;jenkins-hbase4:44809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e5f4585 to 127.0.0.1:61376 2023-09-13 21:02:38,688 INFO [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-13 21:02:38,690 DEBUG [RS:2;jenkins-hbase4:44809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:02:38,690 DEBUG [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-13 21:02:38,690 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1478): Online Regions={6581cac807262776d608b6587b7b41b8=hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8.} 2023-09-13 21:02:38,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. 2023-09-13 21:02:38,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. 2023-09-13 21:02:38,689 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-13 21:02:38,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. 2023-09-13 21:02:38,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. 2023-09-13 21:02:38,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. after waiting 0 ms 2023-09-13 21:02:38,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. 2023-09-13 21:02:38,690 INFO [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-13 21:02:38,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6581cac807262776d608b6587b7b41b8 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-13 21:02:38,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. after waiting 0 ms 2023-09-13 21:02:38,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. 2023-09-13 21:02:38,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-13 21:02:38,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1a7fc3008ef22f78d576b5eff38bc7af 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-13 21:02:38,691 DEBUG [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(1478): Online Regions={1a7fc3008ef22f78d576b5eff38bc7af=hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af.} 2023-09-13 21:02:38,691 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-13 21:02:38,691 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-13 21:02:38,691 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-13 21:02:38,691 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-13 21:02:38,691 DEBUG [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-13 21:02:38,691 DEBUG [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1504): Waiting on 6581cac807262776d608b6587b7b41b8 2023-09-13 21:02:38,692 DEBUG [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(1504): Waiting on 1a7fc3008ef22f78d576b5eff38bc7af 2023-09-13 21:02:38,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/acl/6581cac807262776d608b6587b7b41b8/.tmp/l/2b42136b9afd4911a3253aea7d2a651e 2023-09-13 21:02:38,721 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-13 21:02:38,721 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-13 21:02:38,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/namespace/1a7fc3008ef22f78d576b5eff38bc7af/.tmp/info/6dcf4c6390384c1e94f4666d2489904e 2023-09-13 21:02:38,723 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-13 21:02:38,731 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/.tmp/info/e4b28ee443cb4c21b243a550b7b15b00 2023-09-13 21:02:38,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b42136b9afd4911a3253aea7d2a651e 2023-09-13 21:02:38,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/acl/6581cac807262776d608b6587b7b41b8/.tmp/l/2b42136b9afd4911a3253aea7d2a651e as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/acl/6581cac807262776d608b6587b7b41b8/l/2b42136b9afd4911a3253aea7d2a651e 2023-09-13 21:02:38,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/namespace/1a7fc3008ef22f78d576b5eff38bc7af/.tmp/info/6dcf4c6390384c1e94f4666d2489904e as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/namespace/1a7fc3008ef22f78d576b5eff38bc7af/info/6dcf4c6390384c1e94f4666d2489904e 2023-09-13 21:02:38,736 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4b28ee443cb4c21b243a550b7b15b00 2023-09-13 21:02:38,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/namespace/1a7fc3008ef22f78d576b5eff38bc7af/info/6dcf4c6390384c1e94f4666d2489904e, entries=2, sequenceid=6, filesize=4.8 K 2023-09-13 21:02:38,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1a7fc3008ef22f78d576b5eff38bc7af in 48ms, sequenceid=6, compaction requested=false 2023-09-13 21:02:38,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b42136b9afd4911a3253aea7d2a651e 2023-09-13 21:02:38,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/acl/6581cac807262776d608b6587b7b41b8/l/2b42136b9afd4911a3253aea7d2a651e, entries=7, sequenceid=18, filesize=5.2 K 2023-09-13 21:02:38,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 6581cac807262776d608b6587b7b41b8 in 53ms, sequenceid=18, compaction requested=false 2023-09-13 21:02:38,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/namespace/1a7fc3008ef22f78d576b5eff38bc7af/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 21:02:38,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:02:38,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. 2023-09-13 21:02:38,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1a7fc3008ef22f78d576b5eff38bc7af: 2023-09-13 21:02:38,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1694638818478.1a7fc3008ef22f78d576b5eff38bc7af. 2023-09-13 21:02:38,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/acl/6581cac807262776d608b6587b7b41b8/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-13 21:02:38,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:02:38,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. 2023-09-13 21:02:38,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6581cac807262776d608b6587b7b41b8: 2023-09-13 21:02:38,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1694638819229.6581cac807262776d608b6587b7b41b8. 2023-09-13 21:02:38,764 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/.tmp/rep_barrier/173c084d24cb4f0ba2f15cbf0f4f4ad4 2023-09-13 21:02:38,768 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 173c084d24cb4f0ba2f15cbf0f4f4ad4 2023-09-13 21:02:38,776 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/.tmp/table/521aacbe74fd4544934892137ac05ffa 2023-09-13 21:02:38,780 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 521aacbe74fd4544934892137ac05ffa 2023-09-13 21:02:38,781 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/.tmp/info/e4b28ee443cb4c21b243a550b7b15b00 as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/info/e4b28ee443cb4c21b243a550b7b15b00 2023-09-13 21:02:38,785 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4b28ee443cb4c21b243a550b7b15b00 2023-09-13 21:02:38,785 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/info/e4b28ee443cb4c21b243a550b7b15b00, entries=48, sequenceid=131, filesize=10.3 K 2023-09-13 21:02:38,786 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/.tmp/rep_barrier/173c084d24cb4f0ba2f15cbf0f4f4ad4 as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/rep_barrier/173c084d24cb4f0ba2f15cbf0f4f4ad4 2023-09-13 21:02:38,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 173c084d24cb4f0ba2f15cbf0f4f4ad4 2023-09-13 21:02:38,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/rep_barrier/173c084d24cb4f0ba2f15cbf0f4f4ad4, entries=13, sequenceid=131, filesize=6.4 K 2023-09-13 21:02:38,791 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/.tmp/table/521aacbe74fd4544934892137ac05ffa as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/table/521aacbe74fd4544934892137ac05ffa 2023-09-13 21:02:38,795 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 521aacbe74fd4544934892137ac05ffa 2023-09-13 21:02:38,795 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/table/521aacbe74fd4544934892137ac05ffa, entries=24, sequenceid=131, filesize=6.9 K 2023-09-13 21:02:38,796 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 105ms, sequenceid=131, compaction requested=false 2023-09-13 21:02:38,807 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-13 21:02:38,808 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 21:02:38,808 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-13 21:02:38,808 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-13 21:02:38,808 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-13 21:02:38,808 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-13 21:02:38,873 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-13 21:02:38,873 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-13 21:02:38,891 INFO [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43255,1694638816358; all regions closed. 2023-09-13 21:02:38,892 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42107,1694638816311; all regions closed. 2023-09-13 21:02:38,892 INFO [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44809,1694638816394; all regions closed. 2023-09-13 21:02:38,906 DEBUG [RS:0;jenkins-hbase4:42107] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/oldWALs 2023-09-13 21:02:38,907 DEBUG [RS:1;jenkins-hbase4:43255] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/oldWALs 2023-09-13 21:02:38,907 INFO [RS:0;jenkins-hbase4:42107] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42107%2C1694638816311:(num 1694638818044) 2023-09-13 21:02:38,907 DEBUG [RS:2;jenkins-hbase4:44809] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/oldWALs 2023-09-13 21:02:38,907 DEBUG [RS:0;jenkins-hbase4:42107] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:02:38,907 INFO [RS:1;jenkins-hbase4:43255] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43255%2C1694638816358.meta:.meta(num 1694638818189) 2023-09-13 21:02:38,907 INFO [RS:0;jenkins-hbase4:42107] regionserver.LeaseManager(133): Closed leases 2023-09-13 21:02:38,907 INFO [RS:2;jenkins-hbase4:44809] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44809%2C1694638816394:(num 1694638818044) 2023-09-13 21:02:38,907 DEBUG [RS:2;jenkins-hbase4:44809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:02:38,907 INFO [RS:2;jenkins-hbase4:44809] regionserver.LeaseManager(133): Closed leases 2023-09-13 21:02:38,907 INFO [RS:2;jenkins-hbase4:44809] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-13 21:02:38,907 INFO [RS:0;jenkins-hbase4:42107] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-13 21:02:38,907 INFO [RS:2;jenkins-hbase4:44809] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-13 21:02:38,908 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-13 21:02:38,908 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-13 21:02:38,908 INFO [RS:0;jenkins-hbase4:42107] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-13 21:02:38,908 INFO [RS:0;jenkins-hbase4:42107] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-13 21:02:38,908 INFO [RS:0;jenkins-hbase4:42107] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-13 21:02:38,908 INFO [RS:2;jenkins-hbase4:44809] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-13 21:02:38,909 INFO [RS:2;jenkins-hbase4:44809] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-13 21:02:38,911 INFO [RS:2;jenkins-hbase4:44809] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44809 2023-09-13 21:02:38,911 INFO [RS:0;jenkins-hbase4:42107] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42107 2023-09-13 21:02:38,914 DEBUG [RS:1;jenkins-hbase4:43255] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/oldWALs 2023-09-13 21:02:38,914 INFO [RS:1;jenkins-hbase4:43255] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43255%2C1694638816358:(num 1694638818044) 2023-09-13 21:02:38,914 DEBUG [RS:1;jenkins-hbase4:43255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:02:38,914 INFO [RS:1;jenkins-hbase4:43255] regionserver.LeaseManager(133): Closed leases 2023-09-13 21:02:38,914 INFO [RS:1;jenkins-hbase4:43255] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-13 21:02:38,914 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-13 21:02:38,915 INFO [RS:1;jenkins-hbase4:43255] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43255 2023-09-13 21:02:38,918 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:02:38,918 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:02:38,918 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 21:02:38,918 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 21:02:38,918 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43255,1694638816358 2023-09-13 21:02:38,918 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 21:02:38,918 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 21:02:38,919 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:02:38,919 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:02:38,919 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:02:38,919 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:02:38,919 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44809,1694638816394 2023-09-13 21:02:38,919 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42107,1694638816311 2023-09-13 21:02:38,921 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42107,1694638816311] 2023-09-13 21:02:38,921 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42107,1694638816311; numProcessing=1 2023-09-13 21:02:38,922 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42107,1694638816311 already deleted, retry=false 2023-09-13 21:02:38,923 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42107,1694638816311 expired; onlineServers=2 2023-09-13 21:02:38,923 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44809,1694638816394] 2023-09-13 21:02:38,923 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44809,1694638816394; numProcessing=2 2023-09-13 21:02:38,924 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44809,1694638816394 already deleted, retry=false 2023-09-13 21:02:38,924 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44809,1694638816394 expired; onlineServers=1 2023-09-13 21:02:38,924 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43255,1694638816358] 2023-09-13 21:02:38,924 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43255,1694638816358; numProcessing=3 2023-09-13 21:02:38,926 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43255,1694638816358 already deleted, retry=false 2023-09-13 21:02:38,926 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43255,1694638816358 expired; onlineServers=0 2023-09-13 21:02:38,926 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33631,1694638815069' ***** 2023-09-13 21:02:38,926 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-13 21:02:38,927 DEBUG [M:0;jenkins-hbase4:33631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68ef7ff4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-13 21:02:38,927 INFO [M:0;jenkins-hbase4:33631] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33631,1694638815069 2023-09-13 21:02:38,927 INFO [M:0;jenkins-hbase4:33631] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33631,1694638815069; all regions closed. 2023-09-13 21:02:38,927 DEBUG [M:0;jenkins-hbase4:33631] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 21:02:38,927 DEBUG [M:0;jenkins-hbase4:33631] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-13 21:02:38,927 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-13 21:02:38,927 DEBUG [M:0;jenkins-hbase4:33631] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-13 21:02:38,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694638817664] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694638817664,5,FailOnTimeoutGroup] 2023-09-13 21:02:38,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694638817664] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694638817664,5,FailOnTimeoutGroup] 2023-09-13 21:02:38,927 INFO [M:0;jenkins-hbase4:33631] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-13 21:02:38,927 INFO [M:0;jenkins-hbase4:33631] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-13 21:02:38,927 INFO [M:0;jenkins-hbase4:33631] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-13 21:02:38,927 DEBUG [M:0;jenkins-hbase4:33631] master.HMaster(1512): Stopping service threads 2023-09-13 21:02:38,928 INFO [M:0;jenkins-hbase4:33631] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-13 21:02:38,928 ERROR [M:0;jenkins-hbase4:33631] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-13 21:02:38,928 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-13 21:02:38,928 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 21:02:38,928 INFO [M:0;jenkins-hbase4:33631] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-13 21:02:38,928 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-13 21:02:38,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 21:02:38,929 DEBUG [M:0;jenkins-hbase4:33631] zookeeper.ZKUtil(398): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-13 21:02:38,929 WARN [M:0;jenkins-hbase4:33631] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-13 21:02:38,929 INFO [M:0;jenkins-hbase4:33631] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-13 21:02:38,929 INFO [M:0;jenkins-hbase4:33631] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-13 21:02:38,929 DEBUG [M:0;jenkins-hbase4:33631] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-13 21:02:38,929 INFO [M:0;jenkins-hbase4:33631] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 21:02:38,930 DEBUG [M:0;jenkins-hbase4:33631] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 21:02:38,930 DEBUG [M:0;jenkins-hbase4:33631] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-13 21:02:38,930 DEBUG [M:0;jenkins-hbase4:33631] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 21:02:38,930 INFO [M:0;jenkins-hbase4:33631] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.65 KB heapSize=451.95 KB 2023-09-13 21:02:38,947 INFO [M:0;jenkins-hbase4:33631] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.65 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6dff0af6787d4dc7bc47b8ec0f7ce1b1 2023-09-13 21:02:38,951 INFO [M:0;jenkins-hbase4:33631] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6dff0af6787d4dc7bc47b8ec0f7ce1b1 2023-09-13 21:02:38,952 DEBUG [M:0;jenkins-hbase4:33631] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6dff0af6787d4dc7bc47b8ec0f7ce1b1 as hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6dff0af6787d4dc7bc47b8ec0f7ce1b1 2023-09-13 21:02:38,956 INFO [M:0;jenkins-hbase4:33631] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6dff0af6787d4dc7bc47b8ec0f7ce1b1 2023-09-13 21:02:38,956 INFO [M:0;jenkins-hbase4:33631] regionserver.HStore(1080): Added hdfs://localhost:45325/user/jenkins/test-data/817a8cae-02a6-0ec0-95c9-ed3808a2ea19/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6dff0af6787d4dc7bc47b8ec0f7ce1b1, entries=119, sequenceid=899, filesize=28.6 K 2023-09-13 21:02:38,957 INFO [M:0;jenkins-hbase4:33631] regionserver.HRegion(2948): Finished flush of dataSize ~375.65 KB/384663, heapSize ~451.93 KB/462776, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=899, compaction requested=false 2023-09-13 21:02:38,959 INFO [M:0;jenkins-hbase4:33631] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 21:02:38,959 DEBUG [M:0;jenkins-hbase4:33631] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-13 21:02:38,962 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-13 21:02:38,962 INFO [M:0;jenkins-hbase4:33631] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-13 21:02:38,963 INFO [M:0;jenkins-hbase4:33631] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33631 2023-09-13 21:02:38,964 DEBUG [M:0;jenkins-hbase4:33631] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33631,1694638815069 already deleted, retry=false 2023-09-13 21:02:39,021 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 21:02:39,021 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:43255-0x100a7176b200002, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 21:02:39,021 INFO [RS:1;jenkins-hbase4:43255] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43255,1694638816358; zookeeper connection closed. 2023-09-13 21:02:39,021 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@58a23fb2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@58a23fb2 2023-09-13 21:02:39,121 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 21:02:39,121 INFO [M:0;jenkins-hbase4:33631] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33631,1694638815069; zookeeper connection closed. 2023-09-13 21:02:39,121 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): master:33631-0x100a7176b200000, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 21:02:39,221 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 21:02:39,221 INFO [RS:0;jenkins-hbase4:42107] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42107,1694638816311; zookeeper connection closed. 2023-09-13 21:02:39,222 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:42107-0x100a7176b200001, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 21:02:39,222 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@17695d6f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@17695d6f 2023-09-13 21:02:39,322 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 21:02:39,322 DEBUG [Listener at localhost/33019-EventThread] zookeeper.ZKWatcher(600): regionserver:44809-0x100a7176b200003, quorum=127.0.0.1:61376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 21:02:39,322 INFO [RS:2;jenkins-hbase4:44809] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44809,1694638816394; zookeeper connection closed. 2023-09-13 21:02:39,322 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@60e60591] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@60e60591 2023-09-13 21:02:39,322 INFO [Listener at jenkins-hbase4.apache.org/36385] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-13 21:02:39,323 WARN [Listener at jenkins-hbase4.apache.org/36385] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-13 21:02:39,325 INFO [Listener at jenkins-hbase4.apache.org/36385] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-13 21:02:39,428 WARN [BP-261142847-172.31.14.131-1694638811202 heartbeating to localhost/127.0.0.1:45325] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-13 21:02:39,428 WARN [BP-261142847-172.31.14.131-1694638811202 heartbeating to localhost/127.0.0.1:45325] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-261142847-172.31.14.131-1694638811202 (Datanode Uuid d33da6d0-5ac3-46ae-b04f-c81bb8776361) service to localhost/127.0.0.1:45325 2023-09-13 21:02:39,430 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/dfs/data/data5/current/BP-261142847-172.31.14.131-1694638811202] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 21:02:39,431 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/dfs/data/data6/current/BP-261142847-172.31.14.131-1694638811202] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 21:02:39,432 WARN [Listener at jenkins-hbase4.apache.org/36385] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-13 21:02:39,433 INFO [Listener at jenkins-hbase4.apache.org/36385] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-13 21:02:39,537 WARN [BP-261142847-172.31.14.131-1694638811202 heartbeating to localhost/127.0.0.1:45325] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-13 21:02:39,537 WARN [BP-261142847-172.31.14.131-1694638811202 heartbeating to localhost/127.0.0.1:45325] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-261142847-172.31.14.131-1694638811202 (Datanode Uuid 533fc127-a4d6-4659-a1c3-735037c13115) service to localhost/127.0.0.1:45325 2023-09-13 21:02:39,538 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/dfs/data/data3/current/BP-261142847-172.31.14.131-1694638811202] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 21:02:39,538 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/dfs/data/data4/current/BP-261142847-172.31.14.131-1694638811202] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 21:02:39,539 WARN [Listener at jenkins-hbase4.apache.org/36385] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-13 21:02:39,541 INFO [Listener at jenkins-hbase4.apache.org/36385] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-13 21:02:39,644 WARN [BP-261142847-172.31.14.131-1694638811202 heartbeating to localhost/127.0.0.1:45325] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-13 21:02:39,644 WARN [BP-261142847-172.31.14.131-1694638811202 heartbeating to localhost/127.0.0.1:45325] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-261142847-172.31.14.131-1694638811202 (Datanode Uuid 22183a06-7d67-4386-a8a1-86aadbef7e9a) service to localhost/127.0.0.1:45325 2023-09-13 21:02:39,645 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/dfs/data/data1/current/BP-261142847-172.31.14.131-1694638811202] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 21:02:39,645 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9ca60d5d-53ac-213a-f74a-4cce13ed322b/cluster_b85acd1f-e62d-8571-0e09-01b4bbe5996d/dfs/data/data2/current/BP-261142847-172.31.14.131-1694638811202] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 21:02:39,665 INFO [Listener at jenkins-hbase4.apache.org/36385] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-13 21:02:39,791 INFO [Listener at jenkins-hbase4.apache.org/36385] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-13 21:02:39,884 INFO [Listener at jenkins-hbase4.apache.org/36385] hbase.HBaseTestingUtility(1293): Minicluster is down